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PERFORMANCE-BASED SERVICE ACQUISITION (PBSA) 
STUDY AND GRADUATE LEVEL COURSE MATERIAL 

ABSTRACT 

The purpose of this project is to provide materials and information in the form of 
lessons that will make up a teachable course for graduate students of the Naval Post 
Graduate School. In addition, this research will address the current Department of 
Defense contracting policy, guidance, regulations and lessons learn. Performance-based 
Service Acquisition (PBSA) within the Department of Defense at both other government 
agencies, as well as commercial practices at progressive businesses are examined as they 
relate to PBSA. 

It is important to understand that the PBSA contract form involves acquisition 
strategies, methods, and techniques that define and communicate measurable 
performance expectations in terms of outcomes or results as opposed to directing 
performance methods, processes, systems or broad categories of work activity. To the 
maximum extent possible, the process should describe the work objectives in terms of 
what is to be the required output rather than how the work is to be accomplished and 
placing the responsibility for that accomplishment on the contractor. 

This document contains best practices that have proven useful for drafting 
statements of work, solicitations, and quality assurance plans, and in awarding and 
administering performance-based service acquisitions. This document is not intended to 
be mandatory regulatory guidance, such manuals already exist, but rather assistance to 
agencies and students in implementing performance-based service acquisition more fully 
throughout DOD. 
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EXECUTIVE SUMMARY 


Performance-Based Service Acquisition (PBSA) is a process that all in the 
acquisition and contracting fields need to understand and learn. Laws, policies, and 
regulation have dramatically changed the procurement process into one that must operate 
with a mission-based and program-based focus. Procurement teams, consisting of 
technical, program, financial, logistics, legal and contracting staff, working cooperatively 
across organizational boundaries toward common goals, which is the new model 
employed by performance-based service acquisition. 

The purpose of this publication is to assist agencies in developing policies and 
procedures for implementing PBSA through the creation of PBSA lesson modules for 
utilization of course developers and presenters at the Naval Postgraduate School and 
other institutions delivering higher education to acquisition professionals. The 
information and practices contained in this document were derived from the experience 
of contracting personnel, research of publications, and lessons learned. Information was 
gathered from published articles and existing government guidance, and is incorporated 
into deliverable modules to be shared with these new integrated solution teams that will 
have the responsibility of fully implementing the PBSA policy and methodology. 

Our goal is to effectively integrate all stakeholders’ efforts toward the critical 
success of PBSA and the accomplishment of mission goals. A key objective for this 
publication is to teach and promote the team approach to improve quality and continuity 
for both the acquisition process and the contract management oversight following the 
award. Effective knowledge management is a people issue, not a technology issue. So, 
any new integrated solution team should have the proper training to participate and be 
effective. 
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I. SYLLABUS 


A. PERFORMANCE BASED SERVICE ACQUISITION 

1. Background 

On November 17, 2003 a Memorandum and direetive was issued by the Deputy 
Assistant Seeurity of the Navy (DASN)i for Aequisition establishing reform 
requirements that generally prohibits the aequisition of serviees through the use of a 
eontraet or task order that is not performanee-based. In aeeordanee with Defense Federal 
Aequisition Regulations Supplement (DFARS) 237.170-2 any aequisition of serviees at 
or below $50,000,000 that is not performanee-based now requires approval by the 
Headquarters Contraeting Authority (HCA). 

Performanee Based Serviee Aequisition (PBSA) is a proeess that we all need to 
understand and learn to use to its fullest potential. The sueeess of the performanee-based 
serviee eontraet is dependent on the development and use of performanee measurement 
eriteria and a performanee work statement (PWS) that deseribe the results (the what) 
rather than the aetivity (the how). 

Careful planning, market researeh, more detailed statements of work (SOW) and 
performanee measurement eriteria should inerease the ability to aehieve the goals of 
performanee-based serviee aequisition. 

2. Model Course Description: 

The model eourse promotes a teaeh by doing methodology. This will fully 
integrate the traditional distinet presentation of theoretieal eoneepts and praetieal 
demonstration of the topie to be taught. The eourse learning proeess will use a group 
ease study that demonstrates all aspeets of PBSA. 

The model eourse starts with several eases studies. The partieipating elass will 
divide up into teams and within the teams assign roles for the written exereises. The 
eourse will require eaeh team to take a eustomer requirement and to perform all of the 


1 R. E. Cowley, November 17, 2003. Change to Navy Acquisition Procedures Supplement (NAPS) 
Pertaining to Approval Requirements for Service Acquisitions 


3 



steps that lead up to a performanee based eontract, ineluding the surveillanee plan for the 
post-award management. During this model elass, market researeh, defining 
requirements, writing a performanee based serviee aequisition statement of work 
(performanee work statement or/and a statement of objeetives) for professional serviees 
(engineering, seienee and teehnology, legal serviees, management and aeeounting, 
information teehnology, ete.) is required. Additionally, seleetion of eontaet type, souree 
seleetion plan to include selection criteria, method of evaluation, incentive plan (fee, 
term, etc.), cost estimate are imbedded objectives and requirements. 

The purpose of this process is to take graduate level students through a process 
that encompasses all of the critical process areas listed below. The instructor will use the 
resources and the class time to emphasize the process the students are putting into 
practice through class cases. The mid-term exam is a deliverable product and a short 
presentation by designated student teams to the instructor and class on the progress of 
their performance-based service acquisition package. The final exam is the delivery of 
the final procurement package for the performance-based service acquisition and a 
presentation of their package to the instructor and class. 

3. Reading Materials 

There are no required textbooks for this course. Reading assignments are listed 
on the course outline and may be accessed via the NFS On-Line Blackboard. 
(http://nps.blackboard.com) 

B, COURSE REQUIREMENTS 

1. Performance-Based Service Acquisition Group Project 

Students will break into groups of 3 to 5 people. The group will be responsible 
for the development of a performance-based service acquisition package to include all 
elements of a typical acquisition. They will be responsible for assigning roles and 
responsibilities that are found in a PBS A “Team” and to choose a real defense 
professional service requirement for the project. They will perform the market research, 
the requirements and outcome analysis, develop the performance work statement, the 
source selection methodology, the performance assessment methodology and plan, 
determine the type of contract, incentives, disincentives and penalties, and selection 
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process. It is important to demonstrate the understanding of the PBSA eontraet form 
involving aequisition strategies, methods, and teehniques that define and eommunieate 
measurable performance expectations in terms of outcomes or results as opposed to 
direeting performanee methods, proeesses, systems or broad eategories of work aetivity. 

2. Assessment (Grading) 

Final eourse grades will be based on the two group presentations and the mid¬ 
term and final PBSA paekages. 


Mid-term paekage: 

15% 

Mid-term presentation: 

15% 

Final PBSA paekage: 

30% 

Final presentation: 

20% 

Class partieipation: 

20% 

COURSE OUTLINE 



Session 1: Introduction to Performance-Based Service Acquisition (PBSA) 
Learning Objective Reading Material 


1. The primary learning objeetive of this 
session is to understand the eurrent 
Department of Defense eontraeting poliey, 
guidanee, regulations and lessons learned 
on Performanee-Based Serviee Aequisition. 

2. The seeondary learning objeetive is to 
fully define PBSA and the benefits derived 
from PBSA implementation. 


Department of Defense, Mareh 2001. 
Guidebook for Performance-Based 
Services Acquisition (PBSA) in the 
Department of Defense. Pages 1-4 and 
Appendix J, 

Law, Bob, Deeember 2001. Coming Full 
Cirele. Contraet Management 
Magazine/Deeember 2001, Volume 41, 
Issue 12, Pages 18-23 

Wright, J. L. Capt, USAF and Feeney, J. B. 
TSGT, USAF, September 1999. 10 Most 
Frequently Asked Questions About 
Performanee-Based Serviee Contraets. 
Contraet Management 
Magazine/September 1999, Volume 
39/Issue 9, Pages 10-14 


Session 2: PBSA Integrated Solution Team 

Learning Objective Reading Material 

3. Learn about the Offiee of the Seeretary Pages ii and iii of the Guiding Prineiples 

of Defense’s (OSD) PBSA Guiding are found in Department of Defense, 
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Principals. 

4. Learn how to develop an Integrated 
Product Tern (IPX) for the aequisition 
process. 

5. Learn the roles and responsibilities of 
the “Team” during pre-award and post¬ 
award for the PBSA proeess. 


Session 3: Market Research 
Learning Objective 

6. Learn the role of market research in the 
PBSA proeess (what it is and why we do it) 

7. Learn how to do market research for 
performance-based service aequisitions. 


Mareh 2001. Guidebook for Performance- 
Based Services Acquisition (PBSA) in the 
Department of Defense 

An Interagency-Industry Partnership in 
Performanee, date unknown. Seven Steps 
to Performanee-Based Services 
Acquisition. (Access the Web-Enabled 
version.) 

Weinstoek, Matthew, August 15, 2002. 
Buying Teams, GovExec.com, 

Eerrara, Joe and Johnson, Collie, 
November 1995. Institutionalizing 
Integrated Product Teams, DOD’s 
eommitment to Change, Program Manager 
Magazine, November - Deeember 1995 

Reading Material 

Pages 5 - 7 of the Guiding Principles for 
found in Department of Defense, Mareh 
2001. Guidebook for Performance-Based 
Services Acquisition (PBSA) in the 
Department of Defense 

Pages 11 -13 of An Interagency-Industry 
Partnership in Performance, date unknown. 
Seven Steps to Performanee-Based 
Services Aequisition. (Aceess the Web- 
Enabled version.) 

Weleh, Bob, September 2002. 

Commercial Keys to Performanee-Based 
Acquisition. Contract Management 
Magazine, September 2002, Volume 42, 
Issue 9, Pages 20-24 

Mather, Chip and Costello, Ann, Eebruary 
2001. A Program Manager’s Guide to 
Realizing Marketplace Potential, 
Acquisition Solutions, Inc (Advisory), 
Eebruary 2001 

Dickson, Bob, March 10, 2003. Eederal 
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Contract Law: Feds should use market 
researeh to refine IT plans, Post- 
Newsweek Media, Ine. 

Stokes, Allyson, undated. Market 
Researeh, NIH/Offiee of Aequisition 
Management and Poliey 

Federal Contract Law: Feds should use 
market researeh to refine IT plans 

Session 4: The Performance Requirements and Outcome Analysis 
Learning Objective Reading Material 

8. Learn how to develop and use a Pages 8-10 of the Guiding Prineiples for 

Performanee Requirements and Outeome found in Department of Defense, March 
Analysis. 2001. Guidebook for Performance-Based 

9. Learn how to develop and use a Services Acquisition (PBSA) in the 

Requirements Analysis Matrix Department of Defense 


Rogin, Ronne A., November 22, 2002. 
Performanee-Based Serviee Contraeting. 
Offiee of the Proeurement Exeeutive 
(Department of Treasury) 

GAO, September 2002. Contraet 
Management: Guidanee Needed for Using 
Performance-Based Serviee Contraeting. 
GAO-02-1049 

Offiee of Federal Proeurement Poliey 
(OFPP), Oetober 1998. A Guide to Best 
Praetices for Performanee-Based Serviee 
Contraeting 

Session 5: The Performance Work Statement (PWS)/Statement of Objectives (SOO) 
Learning Objective Reading Material 

10. Learn what a Performanee Work Pages 11-12 and Appendix H of the 

Statement is and the proeess used to Guidebook for Performance-Based 

develop it. Services Acquisition (PBSA) in the 

11. Learn what a Statement of Objectives Department of Defense, March 2001 
is and the proeess used to develop it. 

Pages 17-21 of An Interageney-Industry 
Partnership in Performanee, date unknown. 
Seven Steps to Performance-Based 
Serviees Aequisition. (Aeeess the Web- 
Enabled version.) 
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Petersohn, Henry, April 2003. 
Performance-Based Service Contracting 
for Information Technology Requirements. 
Contract Management Magazine/April 
2003, Volume 43/Issue 4 

Jennings, John B. and Jackson, Jr., Clyde 
P., December 2002. PBSA at the Pentagon 
Contract Management 
Magazine/December 2002, Volume 42, 
Issue 12 Pages 26 -27 

Interagency Task Force on Performance- 
Based Service Acquisition, July 2003. 
Performance-Based Service Acquisition - 
Contracting for the Future, Executive 
Office of the President, Office of 
Management and Budget, Office of 
Federal Procurement Policy 

Department of Energy, August 2001. 
Performance-Based Contracting: 
Development of a Performance Work 
Statement 

Kelman, Stanley, August 8, 1997. 
Performance-Based Service Contracting 
(PBSC) Solicitation/Contract/Task Order 
Review Checklist, 

Mather, Chip and Cotello, Ann, May 2001. 
An Innovative Approach to Performance- 
Based Acquisition: Using SOO, 
Acquisition Directions, Advisory, May 
2001, Acquisition Solutions, Inc. 

Session 6: Performance Incentives and Penalties 

Learning Objective Reading Material 

12. Eearn how to apply and characterize Pages 13-14 and Appendix I of the 

performance incentives and penalties. Guidebook for Performance-Based 

Services Acquisition (PBSA) in the 
Department of Defense, March 2001. 

Pages 26-30 of An Interagency-Industry 
Partnership in Performance, date unknown. 
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Seven Steps to Performanee-Based 
Serviees Aequisition. (Aeeess the Web- 
Enabled version.) 

Garrett, Gregory A., April 2002. 
Performanee-Based Contraeting 
Ineentives: Myths, Best Praetiees, and 
Innovation. Contraet Management 
Magazine/April 2002, Volume 42, Issue 4, 
Pages 14-19 

Owens, James G., Deeember 2003. The 
Ineentive-Term Arrangement: A New 
Strategy for Creating Value. Contraet 
Management Magazine/Deeember 2003, 
Volume 43, Issue 12, Pages 40-41 

Edwards, Vernon J., Eebruary 2002. The 
Award-Term Ineentive: A Status Report, 
Contraet Management Magazine, Eebruary 
2002, Volume 42, Issue 2. Pages 22 -27 

Gill, Jim, Eebruary 2002. Ineentive 
Contraeting, Assessing the Risks, Contraet 
Management Magazine, Eebruary 2002, 
Volume 42, Issue 2, Pages 42-44 

Diekinson, Tom, Eebruary 2001. A Case 
for Multiple Ineentives, Contraet 
Management Magazine, Eebruary 2001, 
Volume 41, Issue 2, Pages 10-13 

Brands, Margaret, Eebruary 2001. Another 
Eook at Award Eee Contraets, Contraet 
Management Magazine, Eebruary 2001, 
Volume 41, Issue 2, Pages 18-25 

Edwards, Vernon J., Eebruary 2001. 
Award-Term: The Newest Ineentive, 
Contraet Management Magazine, Eebruary 
2001, Volume 41, Issue 2, Pages 44-48 

Sean only: The Under Seeretary of 
Defense (Gansler, J.S.), January 5, 2001. 
Ineentive Strategies for Defense 
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Acquisitions, General Policy Guidance, 

Session 7: Methods and Metrics to Assess/Manage Contractor Performance 


Learning Objective 

13. Learn the differenee between “Quality 
Assurance and “Performance Assessment” 
and how to develop a Performanee 
Assessment Plan. 

14. Learn about assessment methodologies. 


Reading Material 

Pages 15-17 and Appendix B and C of the 
Guidebook for Performance-Based 
Services Acquisition (PBSA) in the 
Department of Defense, March 2001. 


Pages 23-26 of An Interagency-Industry 
Partnership in Performance, date unknown. 
Seven Steps to Performance-Based 
Services Aequisition. (Aceess the Web- 
Enabled version.) 


Diemisse, Lisa, June 2003. Performance 
Metries for Non-Mathematicians. Contract 
Management Magazine/June 2003, 

Volume 43/Issue 6, Pages 44-53 

Adam, Peter S., November 2003. 
Performanee-Based Serviee Metrics in IT. 
Contract Management Magazine, 
November 2003, Volume 43, Issue II, 
Pages 18-26 


Session 8: Determine the Type of Service 
Learning Objective 

15. Learn about the different types of 
performanee-based serviee contraets and 
how to pick the right one for your 
proeurement. 

Pages 25 -30 of An Interageney-Industry 
Partnership in Performanee, date unknown. 
Seven Steps to Performance-Based 
Serviees Aequisition. (Aecess the Web- 
Enabled version.) 


GAO, June 2003. Best Practiees: 
Improved Knowledge of DOD Service 
Contracts Could Reveal Significant 
Savings, GAO-03-661 

Contract 
Reading Material 

Pages 13-14 and Appendix B and C of the 
Guidebook for Performance-Based 
Services Acquisition (PBSA) in the 
Department of Defense, March 2001 
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Reynolds, William E., December 2002. 
Performance-Based Contraeting the 
USAID Experienee. Contract 



Management Magazine/Deeember 2002, 
Volume 42, Issue 12, Pages 40-47 

Rosenberger, Robert, December 2003. 
Performance-Based Contracting in a Non- 
Performance-Based World. Contract 
Management Magazine/ December 2003, 
Volume 43, Issue 12, Pages 42-48 

Martin, Lawrence L., November 2002. 
Making Performance-Based Contracting 
Perform: What the Federal Government 
Can learn from State and Local 
Governments, New Ways to Manage 
Series, IBM Endowment for The Business 
of Government, November 2002 

FAR Part 16 


Session 9: Contractor Selection Procedures 

Learning Objective Reading Material 

16. Learn about the contractor selection Pages 18-19 of the Guidebook for 
process, the importance and how to develop Performance-Based Services Acquisition 
the process to meet your PBS A (PBSA) in the Department of Defense, 

requirements. March 2001 

Pages 31 - 36 of An Interagency-Industry 
Partnership in Performance, date unknown. 
Seven Steps to Performance-Based 
Services Acquisition. (Access the Web- 
Enabled version.) 

Hunt III, George R., September 2001. 
Comparing Source Selection Techniques. 
Contract Management 
Magazine/September 2001, Volume 41, 
Issue 9, Pages 10-16 

Gardner, Steve W., June 1998. Source 
Selection in a Streamlined Acquisition 
Environment, Best Business Practices, PM: 
May-June 1998 

Garrett, Gregory A., May 2005. 
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Performance-Based Acquisition: The Real 
Essential Elements, Contract Management 
Magazine, May 2005, Volume 45, Issue 5, 
Pages 42-49 

Session 10: Effective Management of Post-award Contract Performance 
Learning Objective Reading Material 

17. Eearn about the importance of effective 20 o^ihe, Guidebook for 

management of post-award contract Performance-Based Services Acquisition 

performance and how the PBS A “Team” (PBSA) in the Department of Defense, 

must stay intact and assume different roles March 2001 
and responsibilities. 

Pages 37-41 of An Interagency-Industry 
Partnership in Performance, date unknown. 
Seven Steps to Performance-Based 
Services Acquisition. (Access the Web- 
Enabled version.) 

Reed, Anne and Welch, Bob, November 
2005. Performance-Based Acquisition 
Reguires the Six Disciplines of 
Performance-Based Management, Contract 
Management Magazine, November 2005, 
Volume 45, Issue 11, Pages 16-25 

Burman, Allan V., July 2000. Moving 
Backward to Get Ahead, Government 
Executive Magazine, July 2000, Volume 5 
No. 3 

Lawther, Wendell C., January 2002, 
Contracting for the 2E* Century: A 
Partnership Model, New Ways to Manage 
Series, January 2002, The 
PricewaterhouseCooper Endowment, The 
Business of Government. 

Reading Material 

Other Team’s packages 

Reading Material 

Other Team’s packages 

Tablet. Course Outline 


Session 11 - Team Presentations 
Learning Objective 
See what we have learned 
Session 12 - Team Presentations 
Learning Objective 
See what we have learned 
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II. INTRODUCTION 


Government-wide performanee-based serviee aequisition (PBSA) poliey was first 
eontained in Offiee of Federal Proeurement Poliey (OFPP) Letter 91-2 on serviee 
eontraeting that was issued on April 9, 1991. The OFPP letter was prompted by 
unsatisfaetory performanee and eontraet administration that eoineided with an inerease in 
Government’s aequisition of services. The OFPP PBSA policy was subsequently 
incorporated in the Federal Acquisition Regulation (FAR), which defines PBSA as 
“structuring all aspects of an acquisition around the purpose of the work to be performed 
with the contract requirements set forth in clear, specific, and objective terms with 
measurable outcomes as opposed to either the manner by which the work is to be 
performed or broad and imprecise statements of work. ”2 

PBSA offers significant gains in contract quality, potential for cost savings, 
contractor responsiveness, and customer satisfaction. Though the implementation of 
PBSA has met with some resistance because of imbedded traditional methods of buying 
services and a misunderstanding of the how to apply PBSA, most of this can be overcome 
through proper training. With a declining acquisition workforce, contracting for the 
future must embrace these concepts and become more proficient in the use of PBSA. The 
federal government must overcome the barriers to fully adopt PBSA techniques as 
standard business practice. 

The OFPP3 and DOD4 have each published best practices guidelines for the 
implementation of PBSA. This has gone a long way to further the implementation of 
PBSA, however, ineffective communications within acquisition teams (especially with 
program officials) and minimal investment in PBSA training remain impediments to 
wide-spread acceptance and implementation. Just as PBSA is a strategy that focuses on 

2 FAR Part 2.101 Definitions 

3 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition, http://www.acqnet.gov (November 2005) 

4 Department of Defense, March 2001. Guidebook for Performance-Based Services Acquisition 
(PBSA) in the Department of Defense. http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf 
(November 2005) 
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results, so must the training solutions that overeome these obstaeles standing in the way 
of full and effeetive implementation of PBS A. 

This instruetor guide and assoeiated materials was erafted to enhanee the training 
and usage of existing material. It gives a better understanding of the materials available 
and provides a baseline training exereise that allows for hands-on, leam-by-doing 
approaeh to teaehing both the aequisition workforee and teehnieal or program 
management students how to partieipate and lead a PBSA aequisition. 

There are many aequisition teams that have awarded and sueeessfully managed 
PBSA eontraets in spite of any barriers that may have stood in the way. The purpose of 
this instruetor guide is to assist in the implementation of a eourse or eourses that will 
assist with further implementation and sueeess of PBSA throughout the federal 
government. Good luek with your training and further implementation of PBSA. 
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III. SESSION 1: INTRODUCTION TO PERFORMANCE-BASED 
SERVICE ACQUISITION (PBSA) 


A. LEARNING OBJECTIVES 

1. The primary learning objective of this session is to understand the current 
Department of Defense contracting policy, guidance, regulations and 
lessons learned on Performance-Based Service Acquisition. 

2. The secondary learning objective is to fully define PBSA and the benefits 
derived from PBSA implementation. 

B. INTRODUCTION 

In this session performance-based contracting will be introduced as a process for 
doing service contracts for Department of Defense (DOD) and other federal agencies. It 
will discuss the terms used in performance-based service acquisition (PBSA) and 
regulation, policy and guidance that are driving the implementation. Using this instructor 
guide, along with the readings, will guide you through the process and provide some 
insight into the benefits of PBSA. 

C. READING MATERIALS FOR SESSION 1 
1, Instructor 

Department of Defense, March 2001. Guidebook for Performance-Based Services 
Acquisition (PBSA) in the Department of Defense. 

http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf (November 2005) 

FAR - Part 37 Service Contracting. 

http://farsite.hill.af.mil/reghtml/regs/far2afmcfars/fardfars/far/37.him (November 2005) 

Department of Defense, 6/25/2004. Dispatch: Defense FAR Supplement - 
Commercial Procedures for Performance Based Service Contracts. 

http://fedgovcontracts.com/pe04-l 11 .htm (November 2005) 

Army Material Command, October 13, 2004. Performance Based Service 
Acquisition (PBSA) . http://www.amc.army.mil/amc/rda/rda-ap/pbsa.html 

Office of Federal Procurement Policy (OFPP), October 1998. A Guide to Best 
Practices for Performance-Based Service Contracting. http://www.amet.gov/Librarv 
(November 2005) 

Federal Register, July 21, 2004. Federal Acquisition Regulation; Performance- 
Based Service Acquisition; Proposed Rules. Federal Register/Vol. 69, No. 139 

Law, Bob, December 2001. Coming Full Circle. Contract Management 
Magazine/December 2001, Volume 41, Issue 12, Pages 18-23 
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Wright, J. L. Capt, USAF and Feeney, J. B. TSGT, USAF, September 1999. 10 
Most Frequently Asked Questions About Performance-Based Service Contracts. 

Contract Management Magazine/September 1999, Volume 39/Issue 9, Pages 10-14 

An Interagency-Industry Partnership in Performance, date unknown. Seven Steps 
to Performance-Based Services Acquisition, http://www.acqnet.gov (November 2005) 

Office of Federal Procurement Policy (OFPP), October 1998. A Guide to Best 
Practices for Performance-Based Service Contracting. 

http://ww.amet.gov/Librarv/OFPP/BestPractices/PPBSC/BestPPBSC.html (November 
2005) 

2, Student 

Department of Defense, March 2001. Guidebook for Performance-Based Services 
Acquisition (PBSA) in the Department of Defense. Pages 1-4 and Appendix J, 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf 

Law, Bob, December 2001. Coming Full Circle. Contract Management 
Magazine/December 2001, Volume 41, Issue 12, Pages 18-23 

Wright, J. L. Capt, USAF and Feeney, J. B. TSGT, USAF, September 1999. 10 
Most Frequently Asked Questions About Performance-Based Service Contracts. 

Contract Management Magazine/September 1999, Volume 39/Issue 9, Pages 10-14 

D. WHAT IS PBSA? 

The Department of Defense’s “Guidebook for Performance-Based Services 
Acquisition (PBSA) in the Department of Defense, “dated December 20005 defines 
PBSA as “acquisition strategies, methods, and techniques that describe and communicate 
measurable outcomes rather than direct performance processes. It is stmctured around 
defining a service requirement in terms of performance objectives and providing 
contractors the latitude to determine how to meet those objectives. Simply put, it is a 
method for acquiring and placing responsibility for how it is accomplished on the 
contractor.” According to J.S. Gansler, The Under Secretary of Defense, January 2001®, 
the guidebook has the following goals: 

• To promote performance-based strategies for services acquisition 
throughout the Department of Defense. 


5 Department of Defense, March 2001. Guidebook for Performance-Based Services Acquisition 
(PBSA) in the Department of Defense. http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf 
(November 2005) 

6 J.S. Gansler, 2 January 2001, No Subject, cover letter for Guidebook for Performance-Based 
Services Acquisition in the Department of Defense. 
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• To educate the acquisition workforce and highlight the key element of 
performance-based acquisition 

• To encourage innovative business practices within the DOD acquisition 
process. 

• To promote the use of the commercial market place. 

• To increase awareness that performance-based services acquisitions 
require participation from all stakeholders (the users, acquisition 
workforce personnel and industry) to ensure the requirement is adequately 
satisfied. 

E, HISTORICAL PROSPECTIVE OF PBSA 

“Nearly a century ago, the U.S. government used performance-based contracting 
to acquire one of the nation’s most historically significant purchases” Bob Law states in 
his article Coming Full Circle. 7 The year of the award was 1908 and the winning 
contractor was the partnership of Wilbur and Orville Wright. The Army went from 
solicitation to delivery of a complex, revolutionary weapons system in less than 10 
months. The Army Signal Corps used incentives and an abbreviated performance-based 
specification for delivery of a research and development prototype system and solicited 
for a “heavier-than-air flying machine,” that became the airplane. When comparing the 
Signal Corps’ work in 1908 to today’s FAR requirements, it appears that the Army did 
award a true performance-based contract to the Wright brothers. But, just as the Army 
learned in 1908 upon taking delivery of its new aircraft, today’s government acquisition 
personnel are learning that it will take qualified and well-trained team of professionals 
working together to overcome the obstacles and fully develop the potential of 
performance-based service acquisition. 

The FAR Part 37.6 sets forth today’s criteria for the minimum mandatory 
requirements for performance-based contract. It is interesting to see how the Army’s 
performance-based purchase of the Wright flyer compares to the current FAR. The 
specific elements include: 


7 Bob Law, December 2001. Coming Full Circle, Contract Management Magazine/December 2001, 
Vol. 1, Issue 12, pp. 18-23. 


17 



1. The contract must set forth a performance requirement that defines the 
work in measurable, mission-related terms. With the Wright flyer, the 
army did set forth its performance requirement for a heavier-than-air 
flying machine in measurable, mission-related terms. 

2. The contract must establish - in terms such as quality, quantity, or 
timeliness - specific, measurable performance standards that must be 
attained. These standards must be tied to performance requirements. The 
army’s performance specification for a heavier-than-air flying machine 
required that the device carry two men aloft at a minimum speed of 40 
miles per hour for at least 60 minutes. 

3. A government quality assurance plan must be established that describes 
how the contractor’s performance will be measured against the 
performance standards. The Army Signal Corps’ contract set forth 
requirements for load, transportability, maximum speed, and endurance. 
While lacking a specific quality assurance plan to establish how the 
inspectors would review the flyer, the contract’s requirements were clear 
and unambiguous. However, a substantive quality assurance plan might 
have mitigated the need for a panel of eight officers to inspect the aircraft 
during the acceptance test. 

4. The government must include specific procedures for reducing fees or 
prices of a fixed-price contract when services are not performed or do not 
meet contract requirements, and must include performance incentives 
where appropriate. The incentive included in the Wright brothers’ 
contract was in the amount of $25,000 and the aircraft was required to 
perform as specified. If the flyer could remain aloft for more than one 
hour, the brothers could obtain an additional $5,000 bonus - which they 
did ultimately earn. 

F. PBSA TERMS AND DEFINITIONS 

To meet the criteria for “performance-based,” an acquisition should contain, at a 
minimum, the following essential elements, which will be examined in greater detail in 
other sessions: 

• Performance Work Statement (PWS) or Statement of Objectives (SOO) 
- Describes the requirement(s) in terms of measurable results or 
delineation of explicit objectives rather than by detailed prescriptive 
methods. 

• Performance Measurement Factors/Standards (PMFs) - Criteria and 
related performance metrics by which to determine whether performance 
outcomes have been met; defining what is considered “acceptable 
performance.” 

• Incentives, Disincentives or Penalties - While not mandatory, incentives 
should be used, as appropriate, to encourage performance that will exceed 
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the required performance standards. Penalties and incentives complement 
each other. Disincentives are contract provisions or penalties that address 
how to manage performance that does not meet established performance 
standards. 

• Quality Assurance Plan (QAP) [also the Quality Assurance Surveillance 
Plan (QASP); formerly the Performance Assessment Plan (PAP) in DOD] 
-Methodology for determining how contractor performance will be 
measured and assessed against established objective performance 
standards. 

G. POLICY BACKGROUND AND AUTHORITIES 

On November 17, 2003 a Memorandum and directive came down from Deputy 
Assistant Secretary of the Navy (DASN) for Acquisition (ACQ)8 with changes to the 
Navy Acquisition Procedures Supplement (NAPS), establishing a reform requirement 
that generally prohibits the acquisition of services through the use of a contract or Task 
Order (TO) that is not performance-based. DOD policy at that time also required that 
50% of services acquisitions (in terms of both dollars and actions) had to be performance- 
based by year 2005. An 0MB Office of Federal Procurement Policy (OFPP) 
Memorandum, “Increasing the Use of Performance-Based Service Acquisition,” issued 
on September 7, 20049 and which became effective for all agencies on October 1, 2004, 
refines policy and redefines the original target PBSA achievement levels of 50% of 
contract actions and dollars to instead be based solely on “40% of eligible contract dollars 
awarded in FY 2005.” A further policy clarification in the Directive defined that “if more 
than 50% of a contract requirement is performance-based, as measured in dollars, the 
entire service action may be coded as a PBSA.” These revisions in policy and the target 
PBSA achievement levels have been driven by broadly developed interagency experience 
and recognition that, “there are a few types of services that are not particularly well suited 
to PBSA.” Such services as General Science and Technology R&D phases, including: 1) 
Basic Research, 2) Applied Research, 3) Advanced Technology Development, 4) 
Demonstration and Validation, and 5) Engineering and Manufacturing Development, 


8 R. E. Cowley, November 17, 2003. Change to Navy Acquisition Procedures Supplement (NAPS) 
Pertaining to Approval Requirements for Service Acquisitions. 

9 Robert A. Burton, Executive Office of the President, Memorandum for Chief Acquisition 
Officers/Senior Procurement Executives, Increasing the Use of Performance-Based Service Acquisition 
http://www.acqnet.gov/Notes/MemoCAO-PE%20Reporting%20Requirements.pdf (November 2005) 
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have been listed as excluded from the list of eligible service contracts or orders for 
mandatory PBSA reporting (FAR 37.102 and the Federal Procurement Data System 
(FPDS) are being revised to update these exclusions). Military Departments have been 
instructed to exclude the listed services having “low potential for utilizing PBSA” when 
computing percentage of PBSA contract dollars (consistent with OFPP) and to “focus 
efforts on the areas of greatest potential benefit.” An additional instruction of Defense 
Federal Acquisition Regulation Supplement (DFARS) 237.170-3 now requires that any 
acquisition of services at or below $50,000,000 that is not performance-based, must be 
approved by the agency Head of Contracting Agency (HCA 

H, PBSA AUTHORITY 

The reform policy establishing a performance-based contracting approach for all 
services except A&E, construction, services incidental to commodity purchases, utilities, 
and the Technology R&D identified above is found in FAR 37.102. It is the policy of the 
Federal Government that (1) agencies use performance-based contracting methods to the 
maximum extent practicable when acquiring services, and (2) agencies carefully select 
acquisition and contract administration strategies, methods, and techniques that best 
accommodate the requirements. 

Further, the Government Performance and Results Act (GPRA) mandates 
accountability in the conduct of these contracting activities. GPRA was put on place 
during the 1990s by congress to improve federal program effectiveness, accountability, 
and service delivery; and enhancing congressional decision making by providing more 
objective information on program performance.lo GPRA requires multi-year strategic 
planning (started in 1997 and must be updated every three years), annual performance 
planning with performance goals, annual performance reporting with performance results 
and verification and validation, and a linkage of the performance results to the budget. 

I. POLICY GUIDANCE 

The OFPP, an office within the Office of Management and Budget (0MB) 
rescinded its 1998 Guide to Best Practices for Performance-Based Service Contracting. 


10 Government Performanee and Result Aet of 1993. http://www.whitehouse.gov/omb/mgmt- 
gpra/gplaw2m.html . (November 2005) 
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Agencies are encouraged by the OFPP Memorandum of September 7, 2004 to develop 
their performance based acquisitions by employing use of the Seven Steps to 
Performance-Based Service Acquisition Guide,! i available at www.acqnet.gov 
(November 2005), which is updated regularly by an interagency team led by the General 
Services Administration (GSA), to reflect the latest policies and best practices. The 
Office of the Under Secretary of Defense, Acquisition Technology and Logistics, issued a 
similar implementing Memorandum earlier on August 19, 2003 directing all DOD 
Secretaries of the Military Departments, Senior Acquisition Executives, and all personnel 
who prepare Statements of Work for services contracts to employ the same referenced 
Guide. 


1, Benefits Deriving from PBSA Implementation 

Performance-based service acquisition can accomplish numerous beneficial 
objectives. They include: 

• Increased likelihood of meeting mission needs through PBSA contractor 
incentivization. 

• Focus is shifted to intended results orientation, not process orientation. 

• Better value and optimization of performance by allowing a contractor to 
provide the required service by following its own best practices. Since the 
prime focus is on the end result, contractors can modify their processes, as 
appropriate, throughout the life of the contract without the encumbrance of 
contract modification approvals, provided that the delivered service 
(results) remains consistent with contract requirements. 

• Reduced performance risk by significant shift from Government to 
industry resulting from contractor responsibility for achievement of 
Statement of Work (SOW) objectives deriving from application of their 
own best practices and processes. 

• No detailed specification or process description needed because of 
results/objectives orientation of solicitations. 

• Enhanced contractor flexibility in proposing solutions based upon exercise 
of its own unique expertise and in-house capabilities. 

• Enhanced competition and innovation is prompted by use of performance 
requirements to maximize opportunities for competitive alternatives in lieu 
of Government-directed solutions. 


11 Seven Steps to Performanee-Based Serviees Aequisition, An interageney-Industry Partnership in 
Performanee, http://www.aeqnet.gov . (November 2005) 
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• Since PBSA allows for greater innovation, it has the potential to attraet a 
broader industry response. [Possibly make this last sentenee a new bullet.] 

• Contraetor buy-in and shared interests also promote innovation and eost 
savings. 

• Performanee assessment of eontraetor ean be less frequent, but more 
meaningful. 

• Results are doeumented for Government Performanee and Results Aet of 
1993 (GPRA) reporting, as an automatie by-produet of Performanee- 
Based Serviee (PBS) aequisition. 

Performanee-based serviee aequisition foeuses on results instead of methods. 
Capt. Jonathan L. Wright, USAF and TSGT Jeffery B. Feeney, USAF talks about how 
performanee is tied to vision and goals in their artiele “10 Most Frequently Asked 
Questions About Performanee-Based Serviee Contraeting.”i2 This gives a good 
perspeetive to the performanee-based eontraeting environment and lessons learned about 
some of the questions that eome up from both the eontraeting and teehnieal eommunities 
and are reeommended reading. 

J. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

Class will divide up into groups of no less than three and no more than five. The 
groups will work together throughout the eourse as the integrated aequisition team. In 
the next session the team’s roles and responsibilities will be further defined. For this 
session an exehange of eontaet and sehedule information should be eompleted. 

Students will aeeess the web-enabled 7 steps performanee-based eontraeting 
guide at http://www.acqnet.gov/Librarv/OFPP/BestPractiees/pbsc/home.html (November 
2005) to beeome familiar with the site. 

K. READINGS ASSIGNMENTS FOR SESSION 2 

Pages iv of the Guidebook for Performanee-Based Serviees Aequisition (PBSA) 
in the Department of Defense, Mareh 2001. 
http://www.dau.mil/pubs/mise/PBSA_GUIDEBOOK.pdf 

An Interageney-Industry Partnership in Performanee, date unknown. Seven Steps 
to Performanee-Based Serviees Aequisition. (Aeeess the Web-Enabled version.) 
http ://www. aeqnet. gov/library/OEPP/BestPraetioes/pbse 


12 Jonathan L. Wright and Jeffery B Feeney, September 1999. 10 Most Frequently Asked Questions 
About Performance-Based Service Contracting. Contracting Management Magazine September 1999, 
Volume 39/Issue 9, pp. 10 -14. 
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Weinstock, Matthew, August 15, 2002. Buying Teams, GovExee.eom, 
http://www.govexee.eom/top200/02top/sl.htm (November 2005) 

Ferrara, Joe and Johnson, Collie, November 1995. Institutionalizing Integrated 
Produet Teams, DOD’s eommitment to Change, Program Manager Magazine, November 
- Deeember 1995. 

http://www.dau.miFpubs/pm/pmpdf95/offsitel.pdf#seareh=’integrated 
%20aequisition%20teams’ (November 2005) 
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IV. SESSION 2: THE INTEGRATED SOLUTION TEAM 


A. LEARNING OBJECTIVES 

1. Learn about the Offiee of the Seeretary of Defense’s (OSD) PBSA 
Guiding Prineipals. 

2. Learn how to develop an Integrated Produet Tern (IPX) for the aequisition 
proeess. 

3. Learn the roles and responsibilities of the “Team” during pre-award and 
post-award for the PBSA proeess. 

B. INTRODUCTION 

In this session there will be a quiek review of on Performanee-Based Serviee 
Aequisition (PBSA) using OSD PBSA Guiding Prineiples. This will introduee the elass 
to the team eoneept and how levels of empowerment are eritieal to sueeess. The foeus of 
the rest of the session will be on the development of the “team” and roles and 
responsibilities the members will assume for pre-award and post-award PBSA proeesses. 
The elass will also look at the web-enabled 7 Steps to Performanee-Based Contraeting 
and its value as the elass earries out their assignments. 

C. READING MATERIALS FOR SESSION 2 
1. Instructor 

Review of the Guiding Prineiples found in Department of Defense, Mareh 2001. 
Guidebook for Performanee-Based Serviees Aequisition (PBSA) in the Department of 
Defense http;//www.dau.miLpubs/mise/PBSA_GUIDEBOOK.pdf (November 2005) 

Review the Web-Enabled applieation of Seven Steps to Performanee-Based 
Serviees Aequisition. http://www.aoqnet.gov (November 2005) 

Kelly, John, Eebruary 2000. Using Teams in the Aequisition Proeess, Defense 
Systems Management College Program Management and Leadership Department 
(Teaohing Note (PM 1), 

http://www.nwo.navy.mil/eleotives_list/EL547/Week2/PMl%20TN2.htm (November 
2005) 

Weinstook, Matthew, August 15, 2002. Buying Teams, GovExeo.oom, 
http://www.govexeo.oom/top200/02top/sLhtm (November 2005) 

Eerrara, Joe and Johnson, Collie, November 1995. Institutionalizing Integrated 
Produot Teams, DOD’s oommitment to Change, Program Manager Magazine, November 
- Deoember 1995. 

http://www.dau.mil/pubs/pm/pmpdf95/offsite Lpdf#searoh=’integrated%20%20aoquisitio 
n%20teams (November 2005) 
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2 . 


Students 


Pages ii and iii of the Guiding Prineiples are found in Department of Defense, 
March 2001. Guidebook for Performance-Based Services Acquisition (PBSA) in the 
Department of Defense. http;//www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf 
(November 2005) 

An Interagency-Industry Partnership in Performance, date unknown. Seven Steps 
to Performance-Based Services Acquisition. (Access the Web-Enabled version.) 
http://www.acqnet.gov (November 2005) 

Weinstock, Matthew, August 15, 2002. Buying Teams, GovExec.com, 
http://www.govexec.eom/top200/02top/sl.htm 

Ferrara, Joe and Johnson, Collie, November 1995. Institutionalizing Integrated 
Product Teams, DOD’s commitment to Change, Program Manager Magazine, November 
- December 1995. 

http://www.dau.miEpubs/pm/pmpdf95/offsitel.pdf#search=’integrated 
%20acquisition%20teams’ (November 2005) 

D. OSD PERFORMANCE-BASED SERVICES ACQUISITION GUIDING 

PRINCIPLES 

“Participants in the acquisition process should work together as a team and 
should be empowered to make decisions within their area of responsibility,”i3 (Statement 
of Guiding Principles for the Federal Acquisition System, FAR 1.102(a), FAR 1.102-3, 
FAR 1.102-4). Clearly defined levels of empowerment are critical to success [of the 
PBSA process]. Laws, policies, and regulations have dramatically changed the 
procurement process into one that must operate with a mission-based and program-based 
focus. Because of this, many more types of people, representing technical, program, 
financial, logistics, legal and contracting staff, working cooperatively across 
organizational boundaries toward a common goal is the new paradigm employed by 
progressive organizations. The goal has been to effectively integrate all stakeholders’ 
efforts toward mission accomplishment. Recognition that team composition can be a 
critical success factor in performance-based acquisition, is the model that 0MB (0MB 
Circular A-11 (2003)) is seeking when it asks the question of agencies in their budget 
submissions: “Will an Integrated Project Team [(IPT)-acquisition team)] manage the 


13 Pages ii and iii of the Guiding Prineiples for found in Department of Defense, December 2000. 
Guidebook for Performance-Based Services Acquisition (PBSA) in the Department of Defense. 
http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf . (November 2005) 
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[acquisition] process?” OMB-OFPP guidelines now deseribe sueh aequisition teams as 
“integrated solutions teams.” 

DOD/OSD, as a key partieipating member of the Federal Aequisition Couneil and 
the Interageney Task Foree for PBSA, embraees the above operating philosophy and 
instruets aequisition personnel to adhere to the following Top-Level Guiding Prineiples: 

• To the maximum extent praetieable, ageneies shall use performanee-based 
methods for aequiring serviees. 

• Fixed-priee, performanee-based eommereial serviee aequisitions are 
eomplementary strategies that eneourage eommereial eontraetors to 
eonduet business with DOD. 

• Utilize a multi-funetional aequisition team to the maximum extent 
praetieable. Support it with a knowledge management infrastrueture. 

• Early planning is essential in determining requirements and assessing 
market eonditions, and it should inelude the user/sponsor and as many 
relevant aequisition team members as possible. 

• To maximize returns for all stakeholders, aequisition strategies should be 
tailored on the basis of experienee, market researeh, and risk. 
Performanee-Based Serviees Aequisition (PBSA) is not a “one size fits 
all” proeess. 

• Strive to define requirements in elear, eoneise language. Foeus on speeifie 
work outeomes and ensure that they are measurable to the greatest extent 
praetieable. 

• Templates are only a partial solution. Sample work statements should be 
individually tailored to the requirement, and for more eomplex 
requirements, work statements should be uniquely erafted. 

• Through market researeh, publie meetings, and draft solieitations, seek 
industry eomment and suggestions regarding performanee objeetives, 
standards, and ineentives. 

• Ineentives should motivate a eontraetor to aehieve performanee levels of 
the highest quality eonsistent with eeonomie effieieney. Ensure that 
ineentives are effeetive and that they refleet value both to the Government 
and to the eontraetor. 

• Contraetor performanee assessments (the proeess known as “quality 
assuranee”) should foeus on outeomes rather than on eontraetor proeesses. 
Eoeus on insight of the eontraetor performanee, not oversight. 

• Periodie assessment of eontraetor performanee should emphasize elear 
eommunieation, with the objeetive of eneouraging and maintaining high 
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standards of performance, and it should be consistent with past- 
performance assessments. 

E. THE PBSA INTEGRATED SOLUTION TEAM 

The “Seven Steps to Performance-Based Acquisition”i4 identities step one as the 
establishment of an integrated solution team. This virtual guide developed recently by an 
interagency-industry team is a good place for the class “teams” to start to look at what 
they have ahead of them. The Department of Commerce and the Office of Federal 
Procurement Policy were the originators of the virtual guide to assist acquisition 
personnel and improve their service contracting skills. It also has the purpose of 
educating the greater “acquisition community,” including the program managers, 
program staff, customers, and others whose participation is vital to a successful 
performance-based acquisition. 

This web-enabled guide (http://205.130.237.il/Library/OFPP/BestPractices/pbsc/ 
home.html) delivers information on the Internet into the seven critical, strategic steps of 
performance-based acquisition, a library of guidance, and li nk s to samples and examples. 
This guide, geared to the greater acquisition community (especially program offices), 
breaks down performance-based service acquisition into seven simple steps. 

• Establish an integrated solutions team 

• Describe the problem that needs solving 

• Examine private-sector and public-sector solutions 

• Develop a performance work statement (PWS) or statement of objectives 

(SOO) 

• Decide how to measure and manage performance 

• Select the right contractor 

• Manage performance 

The intent is to make the subject of performance-based acquisition accessible and 
logical for all and shift the paradigm from traditional “acquisition think” into one of 


14 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov . (November 2005) 
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collaborative, performance-oriented teamwork with a focus on program performance, 
improvement, and innovation, not simply eontract eompliance. 

The PBSA integrated solution team is expected to be a sponsor-foeused, multi¬ 
functional team that plans, implements, and manages a serviee contract throughout the 
life of the requirement. The requirement may be for a single function or for multiple 
activities. Estimated dollar value should not be the sole determinant of the amount of 
effort to be devoted to the aequisition. An integrated solution or acquisition team may be 
made up of many functional experts sueh as the following. 

1. Sponsor/User 

Responsible for defining the requirement, including an assessment of the risk that 
the Government might assume when relying on eommercial speeifieations and common 
marketplace performance and quality standards. The sponsor/user also plays an important 
role in deciding what tradeoffs can be made when eonsidering a eommereially available 
service to fulfill an agency requirement. 

2. Technical Specialist/Project Manager/Program Manager 

These people serve as the prineipal teehnieal experts and are usually the most 
familiar with the requirement and best able to identify potential technical tradeoffs and 
determine whether the requirement ean be met by a commercial solution. 

3, Contracting Officcr/Contract Specialist 

Serves as the principal business advisor and principal agent for the Government 
responsible for developing the solieitation, conducting the souree selection, and 
managing the resultant contract and business arrangement. This individual researches 
contracts in the marketplace to identify general business practiees sueh as commercial 
terms and eonditions, contract type, bid schedule breakout, and the use of incentives. 

4, Cost/Pricc Analyst 

Analyzes and evaluates finaneial priee- and eost-based data for reasonableness, 
eompleteness, accuracy, and affordability. Alternatively, some agencies utilize cost 
engineering personnel from within an engineering division to conduct cost/price analysis 
from a technical standpoint. 
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5, Performance Assessment Personnel (Quality Assurance Personnel): 

Performance assessment personnel are known by many names, such as quality 
assurance evaluator (QAE), Contracting Officer’s Representative (COR), or Contracting 
Officer’s Technical Representative (COTR), but their duties are essentially the same. 
They serve as the onsite technical managers assessing contractor performance against 
contract performance standards. Performance assessment personnel are responsible for 
researching the marketplace to remain current with the most efficient and effective 
performance assessment methods and techniques. 

6, Small and Disadvantaged Business Utilization (SADBU) Specialist 

Serves as the principal advisor and advocate for small business issues. Also serves 

as the liaison with the Small Business Administration (SBA). 

7, Finance/Budget Officer 

Serves as an advisor for fiscal and budgetary issues. 

8, Legal Advisor 

Ensures that the commercial practices and terms and conditions contemplated are 
consistent with the Government's legal rights, duties, and responsibilities. Reviews for 
legal sufficiency and advises on acquisition strategies and contract provisions. 

9, Miscellaneous Others 

Personnel from outside the agency may also be useful, depending on their area of 
expertise. These include people from agencies such as the Defense Eogistics Agency, the 
Defense Contract Audit Agency, the Defense Einance and Accounting Service, the 
Defense Contract Management Agency, and the Environmental Protection Agency, to 
name a few. 

Depending on the size of the acquisition, the size of the team may vary. 
Typically, the teams are much smaller than having representatives from all of the 
elements listed above. The smaller team is more efficient and can go outside of the team 
for expertise as needed. Eor the purposes of the class teams, the roles will be limited to 
what is needed for the team to produce the outcome that is desired for the particular 
requirement. 
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Establishing an integrated solution team is one of the most important steps in a 
suecessful performanee-based service acquisition. Dating back to July 20, 1995, when 
Dr. Paul G. Kaminski, Under Secretary of Defense (Acquisition and Technology), 
hosted a conference on “Institutionalizing Integrated Product Teams; DOD’s 
Commitment to Change,”i5 the implementation of the acquisition team concept has 
been maturing. Though this is an historical look back, the results of over 10 years of 
implementation are starting to pay off. In February 2000, John Kelly introduced 
“Using Teams in the Acquisition Process”i6 to the Defense Systems Management 
College. Mr. Kelly addressed, among other things, the benefits of using teams: 

• Better Focus on Vision, Goals and Tasks 

• Improved Communications 

• Synergy 

• Creativity and I nn ovation 

• Improved Problem Solving and Decision Making 

• Capitalizing on Conflict 

• Professional Development 

• Effective Use of Resources 

• Better Stakeholder Relationships 

Mr. Kelly pointed out that these benefits do not occur automatically simply by 
creating a team and they do not come easily or quickly. Rather, the people (members of 
the team) must take specific actions to transform themselves from a collection of 
individuals into a highly cohesive, effective performing team. This is precisely the intent 
of this course and the objective of this session, to stress the importance teams play in the 
success of the performance-based service acquisition process. 


15 Joe Ferrara and Collie Johnson, November 1995. Institutionalizing Integrated Produet Teams: 
DOD’s Commitment to Change, Program Manager Magazine, November - Deeember 1995 pp. 2-5, 
http ://www.dan.miI/pubs/pm/pmpdf95/offsitel.pdf#seareh=’Integrated%2Qaequisition%20teams ’ 

(November 2005) 

16 John Kelly, February 2000. Using Teams in the Aequisition Proeess, Defense Systems Management 
College Program Management and Leadership Department (Teaehing Note (PM 1), 
http://www.nwe.navy.miFeleetives list/EL547AVeek2/PMl%20TN2.htm (November 2005) 
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Matthew Weinstock’s article Buying Teamsi^, points out that the team’s focus 
has the ultimate goal of developing the best strategy to fulfill the agency’s mission or the 
requirement. Some key features of a successful integrated team, according to an 
Acquisition Solutions’ white paper, are: 

• Shared Leadership. 

• Individual as well as mutual accountability. 

• Collective work products. 

• Performance measures. 

“Building a team is not an easy chore. The team’s leader must be able to bring 
together divergent views and elicit the best from co-workers,” says Christine Stelloh- 
Gamer, head of the Navy’s Acquisition Reform Office. 

Part of the students’ success will rely on how well they are able to build their 
team and get results. Though each team will be responsible for assigning roles to 
individuals, the team should be representative of many types of people, technical, 
program, financial, logistics, legal and contracting staff, working cooperatively across 
organizational boundaries toward a common goal. 

A key objective for this session is to understand the roles and responsibilities of 
the team to improve the quality and continuity of both the acquisition process and the 
contract management oversight following award. The ability to accomplish this 
objective is driven by proper management of a given project's knowledge base. 

F. ROLES AND RESPONSIBILITIES OF THE “TEAM” 

The Federal Acquisition Regulation (FAR) 1.102(a), clearly defined levels of 
empowerment are critical to success. “Participants in the acquisition process should work 
together as a team and should be empowered to make decisions within their area of 
responsibility,” (Statement of Guiding Principles for the Federal Acquisition System). 

Laws, policies, and regulations have dramatically changed the procurement 
process into one that must operate with a mission-based and program based focus. 
Because of this, many more types of people, representing technical, program, 

17 Matthew Weinstock, August 15, 2002. Buying Teams, GovExec.eom, 
http://www.govexee.eotn/top200/02top/s 1 .htm (November 2005) 
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financial, logistics, legal and contracting staff, working cooperatively aeross 
organizational boundaries toward a common goal is the new model employed by 
progressive organizations. 

The goal has been to effectively integrate all stakeholders' efforts toward mission 
aeeomplishment. Reeognizing that team eomposition can be a eritieal sueeess faetor in 
performanee-based acquisition, this is the model that 0MB is seeking when it asks the 
question of agencies in their budget submissions; “Will an Integrated Product Team 
(acquisition team) manage the [aequisition] process?” 

Regardless of its representation, the aequisition team has the daunting 
responsibility for ensuring that its aequisitions:i8 

• Satisfy legal and regulatory requirements; 

• Have performanee objeetives, to the greatest possible extent, consistent 
with the requirements; 

• Successfully meet the mission objectives and intended results; and 

• Requirements for schedule and eost objeetives. 

An important eonsideration is that beeause the eurrent aequisition laws, 
regulations and polieies have ehanged significantly, many more types of people, 
representing technical, program, financial, logistics, legal and eontracting staff, working 
cooperatively across organizational boundaries toward a common goal, is the new 
paradigm that the Office of Management and Budget encourages and inquires about when 
conducting their budget review process for acquisition funding. A key objective for the 
team approach is to improve the quality and continuity of both the acquisition process 
and the contraet management oversight following award. The ability to aeeomplish this 
objective is driven by proper management of a given project’s knowledge base. 


18 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov (November 2005) 
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Developing rules of eonduet for the team, gives clear purpose and a defined 
approach for working together. This was described by Bruce W. Tuckman as a process 
of forming, storming, norming and performing in groups. 19 Tuckman described the stages 
as: 

• Orientation, testing and dependence constitute the group process of 
forming. 

• Resistance to group influence and task requirements and may be labeled as 
storming. 

• Intimate, personal opinions are expressed, thus, we have the stage of 
norming. 

• Structure can now become supportive of task performance and this stage 
can be labeled as performing. 

The next step would be empowerment, which was best described in the guiding 
principles for the Federal Acquisition System covered earlier in this session: “Participants 
in the acquisition process should work together as a team and should be empowered to 
make decision within their area of responsibility.” (FAR 1.102(a)) 

To the maximum extent possible, the process should describe the work objectives 
in terms of what is to be the required, output rather than how the work is to be 
accomplished and placing the responsibility for that accomplishment on the contractor. 
The foundation for a successful acquisition involves a clear answer to these three 

questions: 20 

• What is needed? 

• When and where is it needed? 

• How do we know it is good when we get it? 

G. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

The Teams that were formed in session 1 (3 to 5 students) shall pick a 
requirement for performance-based service acquisition solution that they will use as their 


19 M. K. Smith (2005) 'Bruce W. Tuckman - forming, storming, norming and performing in groups, 
the encyclopedia of informal education, www.infed.org/thinkers/tuckman.htm . Last updated: March 14, 
2005. (November 2005) 

20 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov . (November 2005) 
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class project for the rest of the sessions. They should piek something that the team as a 
whole has some knowledge. Examples: 

• Information Teehnology Serviees 

• Help Desk 

• Seat Management 

• Systems Integration 

• Software Development 

• System Design/Business Proeess Re-Engineering 

• Seienee, Engineering and Teehnieal Assistanee (SETA) Support 

The team shall now define roles and responsibilities (program management, 
aequisition, eustomer, ete.) of eaeh member of the team. The teams may want to piek a 
leader to faeilitate assignment of roles and responsibilities or may be able to divide the 
roles and assign the responsibilities based on the role. Sueeessful teams have shared 
responsibilities as well as shared aceountability; the result of the team effort is oolleetive 
work-produets. This is important part of the forming of the group and how they will be 
able to meet the ehallenges of the following sessions. Often the roles and responsibilities 
are not always elearly divisible between the team members. Keep the eommunieations 
lines open all of the time and share information between the members. 

The team should develop rules of eonduet regardless of how they organize 
themselves. It is important for the team members to understand how they will eonduet 
business within the group. It is aeeeptable if not all members think alike, but the team 
must get past their differenees and get the job done. Empowerment of individual team 
members is key to the sueeess of the team. Eaeh team member should be given 
individual, as well as mutual responsibility and aeeountability for their eontribution to the 
solution. The team should leverage off of the strengths of the team members, so it is 
important for the team to know and reeognize those strengths. All of the skills of the 
eolleetive team and more are neeessary to ereate a true performanee-based approaeh to 
their requirement. 
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The teams shall identify a stakeholder(s) for their requirement, such as a 
customer, the public, an organization, or branch of the military. Understand the 
stakeholder’s interest, objectives and possibly their objections to the solution. 

The team shall approach the solution as if they will have responsibility for the 
requirement until the objectives have been met or delivery by the contractor has been 
completed. Peter Ducker said, “How do you predict the future.. .you create it.” 21 This is 
the mindset the team needs to maintain throughout their project and learning experience. 
Focus both on the acquisition and the project management as if you were responsible 
from the initial discussions of the requirements through contract performance. 

For the next session the teams will turn in the topics for their class projects. 

H, READING ASSIGNMENT FOR SESSION 3 

Pages 5 - 7 of the Guiding Principles for found in Department of Defense, March 
2001. Guidebook for Performance-Based Services Acquisition (PBSA) in the Department 
of Defense. http;//www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 11 -13 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Welch, Bob, September 2002. Commercial Keys to Performance-Based 
Acquisition. Contract Management Magazine/September 2002, Volume 42/Issue 9 

Mather, Chip and Costello, Ann, Eebruary 2001. A Program Manager’s Guide to 
Realizing Marketplace Potential, Acquisition Solutions, Inc (Advisory), Eebruary 2001 
http://www.amc.army.mil/amc/rda/rda-ac/pbsc/adv020I .pdf (November 2005) 

Dickson, Bob, March 10, 2003. Eederal Contract Eaw: Eeds should use market 
research to refine IT plans, Post-Newsweek Media, Inchttp://appserv.gcn.com/cgi- 
bm/udt/im.display.printable?client.id=gcn2&story.id=21329 (November 2005) 

Stokes, Allyson, undated. Market Research, NIH/Office of Acquisition 
Management and Policy, 

http://oamp.od.nih.gov/ProgramNotes/Marketing/marketreserch.htm (November 2005) 


21 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.) p. 7, http://www.acqnet.gov . (November 
2005) 
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Market Research web site 

http://www.acqnet.gov/Library/PreSolicit/presolicit.html (November 2005) 

Federal Contract Law: Feds should use market research to refine IT plans 
http://appserv.gcn.com/cgi-bin/udt/im.display.printable?client.id=gcn2&story.id=21329 
(November 2005) 
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V. SESSION 3: MARKET RESEARCH 


A. LEARNING OBJECTIVE 

1. Learn the role of market researeh in the PBSA proeess (what it is and why 
we do it) 

2. Learn how to do market researeh for performanee-based serviee 
aequisitions. 

B. INTRODUCTION 

Market researeh is the eontinuous proeess of oolleeting and analyzing data to 
determine the eommereial eapability for meeting a speeifie requirement. This is 
neeessary to determine how well the market plaee ean satisfy the need. It basieally helps 
the integrated solution team develop the optimum strategy for meeting the requirements. 
In this session the elass will review the requirements for why market researeh is 
important and how it will be used to begin to formulate their aequisition solution. 

C. READING MATERIAL FOR SESSION 3 
1. Instructor 

Weleh, Bob, September 2002. Commereial Keys to Performanee-Based 
Acquisition. Contract Management Magazine/September 2002, Volume 42/Issue 9 

Mather, Chip and Costello, Ann, February 2001. A Program Manager’s Guide to 
Realizing Marketplace Potential, Acquisition Solutions, Inc (Advisory), February 2001 
http://www.amc.army.mil/amc/rda/rda-ac/pbsc/adv020Lpdf (November 2005) 

Dickson, Bob, March 10, 2003. Federal Contract Law: Feds should use market 
research to refine IT plans, Post-Newsweek Media, Inchttp://appserv.gcn.com/cgi- 
bin/udt/im.display.printable?chent.id=gcn2&story.id=21329 (November 2005) 

Stokes, Allyson, undated. Market Research, NIH/Office of Acquisition 
Management and Policy, 

http://oamp.od.nih.gov/ProgramNotes/Marketing/marketreserch.htm (November 2005) 
Market Research web-site 

http://www.acqnet.gov/Library/PreSolicit/presolicit.html (November 2005) 

Performance-Based Contracting Desk Reference, Know net 
http://knownet.hhs.gov/acquisition/performDR/LAI/UnitOne/whatisa.htm (November 
2005) 
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2 . 


Student 


Pages 5 - 7 of the Guiding Principles for found in Department of Defense, March 
2001. Guidebook for Performance-Based Services Acquisition (PBSA) in the Department 
of Defense. http;//www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 11 -13 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Welch, Bob, September 2002. Commercial Keys to Performance-Based 
Acquisition. Contract Management Magazine/September 2002, Volume 42/Issue 9 

Mather, Chip and Costello, Ann, Eebruary 2001. A Program Manager’s Guide to 
Realizing Marketplace Potential, Acquisition Solutions, Inc (Advisory), Eebruary 2001 
http://www.amc.army.mil/amc/rda/rda-ac/pbsc/adv0201 .pdf (November 2005) 

Dickson, Bob, March 10, 2003. Eederal Contract Eaw: Eeds should use market 
research to refine IT plans, Post-Newsweek Media, Inchttp://appserv.gcn.com/cgi- 
bin/udt/im.display.printable?cbent.id=gcn2&story.id=21329 (November 2005) 

Stokes, Allyson, undated. Market Research, NIH/Office of Acquisition 
Management and Policy, 

http://oamp.od.nih.gov/ProgramNotes/Marketing/marketreserch.htm (November 2005) 

Market Research web-site 

http://www.acqnet.gov/Eibrary/PreSolicit/presolicit.html (November 2005) 

Eederal Contract Law: Eeds should use market research to refine IT plans 
http://appserv.gcn.com/cgi-bin/udt/im.display.printable?client.id=gcn2&story.id=21329 
(November 2005) 

D. WHAT IS “MARKET RESEARCH” AND WHY IS IT NEEDED? 

Market research is a requirement of EAR Part 10, which prescribes the policies 
and procedures for conducting market research to arrive at the most suitable approach to 
acquiring, distributing, and supporting supplies and services. Seven Steps to 
Performance-Based Acquisition22 views market research as an examination of both 
private-sector and public-sector solutions to the intended results of the requirements. It is 
a vital means of providing the team with the expertise they need as a base to start to write 
the performance work statement (PWS). Bob Welch’s article Commercial Keys to 
Performance-Based Service Acquisition, examines some of the best practices from the 
commercial sector that are increasingly being used in government acquisition offices and 
centers. Bob Welch points out that the “right kind” of market research can dramatically 


22 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov . (November 2005) 
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shape an acquisition and draw powerful, solution-oriented ideas from the private sector. 
He thought that the most fruitful and effective market research was one-on-one sessions 
with industry leaders (not “marketers”) to learn the state of the marketplace, commercial 
practices, and commercial performance. One-on-one market research has been 
permissible since the rewrite of FAR Part 15 in 1997. In fact, the FAR specifically 
promotes the exchange of information “among all interested parties, from the earliest 
identification of a requirement through the receipt of proposal. ”23 

Market research is an essential step in writing a performance work statement or 
statement of objectives. Without a good understanding of what is available, the standards 
for performance may be set to high or to low. Getting it right means knowing what you 
can expect when you complete the requirements. As described in the February 2001 
Acquisition Directions Advisory24 “A Program Manager’s Guide to Realizing 
Marketplace Potential,” market research takes place before the government has begun to 
describe its requirements. Market research is the continuous process of collecting 
information to maximize reliance on the commercial marketplace and to benefit from its 
capabilities, technologies, and competitive forces in meeting an agency need. The article 
goes on to talk about the whens, whats and whys of government market research. 

According to the Guide for Performance-Based Service Acquisition in the 
Department of Defense,25 market research is the process of collecting and analyzing 
information on commercial capabilities, processes, pricing, incentives, warranties, and 
delivery and other standard terms and conditions. Information derived from market 
research will help the integrated solutions team develop the optimum acquisition strategy 
for meeting the requirements. 


23 FAR 15.201(a). 

24 Chip Mather and Ann Costello, February 2001. A Program Manager’s Guide to Realizing 
Marketplace Potential, Acquisition Solutions, Inc (Advisory), February 2001 
http://www.amc.army.miFamc/rda/rda-ac/pbsc/adv0201 .pdf . (November 2005) 

25 Department of Defense, March 2001. Guidebook for Performance-Based Services Acquisition 
(PBSA) in the Department of Defense, http://www.dau.miFpubs/misc/PBSA GUIDEBOOK.pdf . 
(November 2005) 
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E. MARKET RESEARCH IN THE PERFORMANCE-BASED ACQUISITION 

PROCESS 

There is no single, stand-alone step for market research in the PBSA process. 
Market research is a continuous process that should be revisited throughout the 
acquisition life cycle. The best approach is for all of the integrated solution team to be 
involved in the market research effort. A shared knowledge and understanding of the 
marketplace will be invaluable in the development of the acquisition strategy and 
performance work statement. Start by becoming familiar with the private-sector sources 
and solutions, check with other agencies for similar acquisitions or existing contracts, 
lessons learned and best practices. Use government and private-sector information data 
bases on past performance of potential sources. Consider one-on-one meetings with 
industry leaders once sources have been identified. 

F. INTEGRATED SOLUTIONS TEAM FUNCTIONS AND 

RESPONSIBILITIES 

Since market research should address both business and technical considerations 
of any requirement, it requires the active participation of all integrated solutions team 
members, as appropriate. These considerations might include technical approaches, 
common quality controls, contract structure, and standard industry terms and conditions. 
Therefore, when market research is being conducted, all members of the integrated 
solutions team should participate, as appropriate to their area of expertise. Some tips from 
the Guidebook for PBSA are to: start early, while the requirement is still flexible; involve 
users in the process; communicate; use teamwork to accomplish your goals; use market 
research to first determine the availability of commercial capabilities, practices, items, 
and services to meet the general requirement; use market research to obtain specific and 
detailed information to make various acquisition decisions; tailor the market research 
efforts, and do not waste valuable time; and refine as you proceed, from general to 
specific. 

A nice guide is a paper from National Institute of Health26, titled simply “Market 
Research,” it provides the answers to a lot of questions through bulletized answers. It 

26 Allyson Stokes, undated. Market Research, NIH/Office of Acquisition Management and Policy, 
http://oamp.od.nih.gov/ProgramNotes/Marketing/marketreserch.htm . (November 2005) 
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provides a more down-to-earth approach to explaining market research and may be 
something easy to follow. One of the features is the appendices. Appendix A gives us 
definitions of terms typically referred to in market research. Appendix B is a listing of all 
of the FAR prescriptions on market research excluding FAR Part 10. Appendix C is a 
sample market research checklist that could be very helpful along with the rest of the 
explanations provided in this paper. 

Market research is not supposed to be easy, but it should be informative and a 
very valuable step in the process of performing a performance-based service acquisition. 
G. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

Establish a preliminary scope statement, identify the objective or purpose of your 
procurement and define an initial magnitude of work to be performed. 

Example: The objective of this effort is to acquire IT services for the Naval Post 
Graduate School, Monterey, CA. 

Start your market research based on the preliminary scope statement, do not be 
afraid of modifying the scope statement based on your market research. The information 
you collect is analyzed to help determine how well your requirement can be met in the 
marketplace. Modification and tailoring of the service requirements is a normal step at 
this stage of the process. Market supportability of your requirements is going to be key 
in order to have adequate competition. Competition typically means either better services 
for the same price or the same services for a better price. The overall purpose of market 
research is to identify commercial practices and widely accepted commercial 
specifications and standards and to determine if there is a service in the commercial 
marketplace that will satisfy the Government requirement. 

This is a good time for the teams to organize and assign responsibilities for 
market research on your requirements. 
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H. READING ASSIGNMENT FOR SESSION 4 

Pages 8 - 10 of the Guidebook for Performance-Based Services Acquisition 
(PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUlDEBOOK.pdf (November 2005) 

Rogin, Ronne A., November 22, 2002. Performance-Based Service Contracting. 
Office of the Procurement Executive (Department of Treasury) 

GAO, September 2002. Contract Management: Guidance Needed for Using 
Performance-Based Service Contracting. GAO-02-1049 

Office of Eederal Procurement Policy (OEPP), October 1998. A Guide to Best 
Practices for Performance-Based Service Contracting. 

http://www.arnet.gov/Eibrary/OPPP/BestPractices/PPBSC/BestPPBSC.html (November 
2005) 
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VI. SESSION 4: THE PERFORMANCE REQUIREMENTS AND 

OUTCOME ANALYSIS 


A. LEARNING OBJECTIVES 

1. Learn how to develop and use a Performanee Requirements and Outeome 
Analysis. 

2. Learn how to develop and use a Requirements Analysis Matrix.. 

B. INTRODUCTION 

In this session we apply the market researeh we have learned to deseribe and 
define our objeetives and desired outeomes for the eontract. This proeess will guide the 
integrated solutions team through a series of in-depth analysis so that they can understand 
the requirements fully in order to articulate the desired outcome in the form of a 
performance work statement or statement of objectives. 

C. READING MATERIAL FOR SESSION 4 

1, Instructor 

Rogin, Ronne A., November 22, 2002. Performance-Based Service Contracting. 
Office of the Procurement Executive (Department of Treasury) 

GAO, September 2002. Contract Management: Guidance Needed for Using 
Performance-Based Service Contracting. GAO-02-1049 

Office of Federal Procurement Policy (OFPP), October 1998. A Guide to Best 
Practices for Performance-Based Service Contracting. 

http://www.arnet.gov/Fibrary/OFPP/BestPractices/PPBSC/BestPPBSC.html (November 
2005) 

Government Performance Results Act of 1993 
http://www.whitehouse.gov/omb/mgmt-gpra/gplaw2m.html (November 2005) 

Acquisition Reform Focus Group, May 13, 1997. Performance-Based Service 
Contracting (Depot & Installation). www.acq.osd.mil/dpap_archive/Docs/focus8.pdf 
(November 2005) 

2. Student 

Pages 8 - 10 of the Guidebook for Performance-Based Services Acquisition 
(PBS A) in the Department of Defens, March 2001. 

http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Rogin, Ronne A., November 22, 2002. Performance-Based Service Contracting. 
Office of the Procurement Executive (Department of Treasury) 
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GAO, September 2002. Contract Management: Guidance Needed for Using 
Performance-Based Service Contracting. GAO-02-1049 

Office of Federal Procurement Policy (OFPP), October 1998. A Guide to Best 
Practices for Performance-Based Service Contracting. 

http://www.arnet.gov/Library/OFPP/BestPractices/PPBSC/BestPPBSC.html (November 
2005) 

D, IDENTIFICATION AND DEFINITION OF REQUIRED 

OBJECTIVES/DESIRED OUTCOMES 

The most effective foundation for a procurement action is the intended effect of 
the contract in supporting and improving an agency’s mission and performance goals and 
objectives (as reported annually to 0MB in accordance with Government Performance 
Results Act of 1993 (GBRA)27). Describing a performance-based acquisition in terms of 
how it supports these mission-based goals allows an agency to clearly establish the 
relationship of an acquisition to its business or mission and sets the stage for crafting a 
procurement action in which the performance goals of the Contractor and the 
Government are synchronized. 

The Guidebook for PBSA28 provides helpful analysis-oriented steps to help 
identify and define the requirements: 

• Definition of Desired Outcomes - A series of analysis-oriented steps to 
help identify and define the sponsor’s overall desired outcomes to be 
accomplished, from a top-level perspective, should be undertaken by 
appropriate team members. This can be a difficult task to properly define, 
but it is intended to be similar to an executive summary or overview of 
key requirements. The correct answers can generally be developed through 
facilitated working sessions with program technical staff, customers, and 
stakeholders. Greater innovation and insight is possible by avoiding the 
temptation to review past paperwork, files, or examination of the status 
quo. 

• Conduct of An Outcomes Analysis - This process identifies specific 
performance objectives for those outcomes defined above. What tasks 
must be accomplished to arrive at the desired outcomes? Performance 
objectives are the specific services that need to be performed and 


27 Government Performance Results Act of 1993 [Why different font?] 
http://www.whitehouse.gov/omb/mgmt-gpra/gplaw2m.html . (November 2005) 

28 Department of Defense, March 2001. Guidebook for Performance-Based Services Acquisition 
(PBSA) in the Department of Defense. http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf . 
(November 2005) 


46 








delivered by the eontraetor, defined in terms of the outeomes. This step 
differs from the overview of the desired outeomes in that it goes into 
greater detail and expands the analysis beyond the top-level overview 
perspeetive to address mission needs. Onee an aequisition is linked to the 
sponsor’s mission needs, the goal is to determine what, specifieally, are 
the ultimate desired results (outeomes, outputs, quality, or any 
eombinations) of eontraet performanee (not how to aeeomplish the goal). 
In other words, what eonstitutes sueeess? Just as important as a elear 
vision of desired results, it is important to establish a elear target for 
sueeess, whieh ean then serve to focus the efforts of the integrated 
solutions team in crafting the acquisition, the contractors in competing for 
award, and the contract management team throughout contract 
performance. These represent two distinct questions that can be asked to 
get a sense of proper direction: 

• Where are we trying to go, and 

• How will we know when we get there? 

In DOD these results are identified as measurable outcomes. This analysis is 
begun by segregating desired outcomes into lower task levels and linking those tasks 
together into a logical flow of activities. To ensure that all critical elements of the 
requirement have been considered, a tree diagram is recommended in order to outline 
each of the basic outcomes (those top-level perspectives). 

• Conduct Performance Requirements Analysis - When or how will it be 
possible to determine that outcomes have been satisfactorily achieved, and 
how much deviation from the performance standard should the contractor 
be allowed, if any? A performance requirements analysis is a process that 
identifies how a performance objective should be measured and thus, what 
performance standards, (e.g., timeliness or quality levels) are appropriate 
and reasonable for that particular performance objective. In this step, 
acceptable quality levels (AQLs), also known as “thresholds,” may be 
identified. Performance standards and AQLs are very important in that 
they identify acceptable levels of performance. Developing and 
establishing performance standards and AQLs are judgment calls based on 
the needs of the mission, available expertise, and market research. A 
critical component of developing these AQLs is determining the current 
level of performance. The primary reason to determine the current level 
of performance is to be able to establish the baseline against which future 
performance can be measured. If one does not know where the beginning 
is, one cannot tell what progress has been made. It is not necessary that the 
Government perform the baseline measurement. In the case of existing 
contracts, an alternative approach would be to require a set of appropriate 
metrics as a deliverable. New solicitations can include a provision for 
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delivery of baseline and/or eurrent performance levels either annually, at 
contract end, or both. The integrated solutions team has to determine the 
adequacy of the baseline data for any new contract to ensure achievement 
of best results. [This determination of the current level of performance 
success assumes the existence of a recent past or present project activity 
from which performance can be extracted.] The members of the integrated 
solutions team should work closely with each other when developing 
standards and AQLs. 

AQLs constitute a minimally acceptable level of performance and are typically 
stated as a percentage of required conformances (e.g., on-time, 95% of the time) or as a 
number of permissible deviations (e.g., 1 error per x time period). In developing AQLs, 
one is asking, “What minimum level of quality is required to meet mission needs?” Not 
every performance standard may necessarily have an AQL. When a performance standard 
does not include an AQL, then one is stating that no deviations are allowed in meeting 
the performance outcome. 

1, Examples of Performance Standards/Performance Measurement 
Factors 

• Response times, delivery times, timeliness - meeting deadlines or due 
dates, adherence to schedule 

• Error rates - number of mistakes/errors allowed in meeting the 
performance standard. 

• Accuracy rates - similar to error rates, but most often stated in terms of 
percentages. 

• Completion milestone rates - x percent complete at a given date. 

• Cost control - keeping within the estimated cost or target cost. Applies in 
cost-reimbursement contract arrangement. 

2, The Performance Requirements Analysis Matrix 

It is helpful to capture the results of the Performance Requirements Analysis in a 
Matrix that can be used as an aid to facilitate later development of a Performance Work 
Statement. DOD recommends a 5-column matrix29 with the following column headers: 

• Performance Objective: What tasks must be accomplished to provide 
the desired outcomes? 


29 Guidebook for Performance-Based Service Acquisition in the Department of Defense, March 2001, 
Appendix B http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf . (November 2005) 
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• Performance Standard: What should be the standards or performance 
measurement factors (PMFs) for completeness, reliability, accuracy, 
timeliness, client satisfaction, quality and/or cost be? 

• Acceptable Quality Level (AQL): How much error is acceptable? 

• Monitoring Method: What will be the determinant that success has been 
achieved? 

• Incentives/Disincentives [for meeting or not meeting the performance 
standards]: What carrot or stick will properly reward good performance or 
address poor performance? 

Another source of examples of a matrix can be found in Ronne Rogin’s paper 
“Performance-Based Service Contracting.”30 This paper provides a very good outline of 
the steps for development of a performance-based service contract with some very good 
examples of performance-based analysis matrixes. He refers to these matrixes as 
“Performance Based Contracting Templates” and they can be found as the attachments to 
his paper. This paper is good information for the teams to use as they develop their 
performance work statements. Ronne Rogin describes the analysis phase to include: 

• Desired results/deliverables (what outcome is required?) 

• Resources needed (are they available?) 

• Workload frequency/quantity of desired work 

• Standards of acceptability 

• Object performance measures (do not forget to take baseline measures so 
progress can be assessed!) 

• How much will it cost? (independent government cost estimate) 

Describing requirements in terms of measurable outcomes and not in terms of 

how to accomplish the requirement is the key to performance-based acquisition. This 
applies equally to labor category descriptions. The Guidebook for PBSA, refers to 
manpower requirements as an example. Manpower requirements were previously 
commonly prescribed in terms of “required number of bodies” or other qualifiers such as 
college degrees or specific years of experience. Prescribing manpower requirements 
limits the ability of offerors to propose their best solutions, and it could preclude the use 

30 Ronne A. Rogin, November 22, 2002. Performance-Based Service Contracting. Office of the 
Procurement Executive (Department of Treasury) 

www.ustreas.gov/offices/management/dcfo/procurement/training/pbscl.pdf (November 2005) 
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of qualified contractor personnel who may be well suited for performing the requirement, 
but may be lacking—for example—a complete college degree or the exact years of 
specified experience. Current DOD guidance is to let the contractor determine his labor 
mix. This position has been driven by provisions of the 2001 Defense Authorization 
Act3i (now implemented in the FAR and DFAR) that specifically prohibit describing any 
minimum experience or educational requirements for proposed contractor personnel 
unless the contracting officer determines that the needs of the agency either (1) cannot be 
met without that requirement or (2) require the use of other than a performance-based 
contract. 

Instead, the requirement should be described in a way that allows offerors to meet 
the requirement by applying alternative sets of resources. Offerors can then propose their 
best solutions for manpower requirements, in accordance with the described requirement. 
Once the offeror submits its proposal, the integrated solutions team will evaluate the 
offeror’s proposal, including manpower solutions, for best value. 

Since performance-based acquisition methodologies are results-oriented, DOD 
organizations should not focus on contractor-proposed labor mixes after contract award, 
as long as the desired outcome is achieved in accordance with the stated performance 
standards and any other requirements in the contract. 

This is a good time to look at some of the Federal Acquisition Regulation that 
apply to performance-based contracting: 

37.102(a) - Establishes performance-based contracting as the preferred method for 
acquiring services. A fixed price contract is preferred, however, other contract types can 
be performance-based. 

37.601 - Prescribes attributes of performance-based contracts as including 

(a) “requirements in terms of results required rather than methods of 
performance” - This would seem to include all completion-type requirements but does not 
necessarily preclude term-type efforts. 

31 National Defense Authorization Act of Fiscal Year 2001 
http://www7.nationalacademies.org/ocga/Laws/PL106 398.asp . (November 2005) 
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(b) “use measurable performanee standards”...” and “quality assurance 
surveillance plans.” Note that dictionaries define “measure” as including qualitative and 
subjective evaluations. This makes the concept very similar to what we do in a best value 
source selection. 

(c) “Specify procedures for reductions to fee or for reductions to the price of a 
fixed-price contract when services are not performed or do not meet contract 
requirements”. Note: FAR already prescribes a fee impact procedure for completion 
requirements if the cost has been expended and all deliveries have not been made. Some 
negotiators also extend the concept to term requirements by asserting that the contractor 
has not delivered his “best efforts”. Also, if a deliverable date or a period of performance 
needs extending, negotiators find out why and routinely receive consideration from the 
contractor (frequently as a fee reduction) if the contractor is at fault. 

(d) “Include performance incentives where appropriate”. Note that monetary 
incentives are not required. Other things can be of value to the contractor - such as the 
annual Contractor Performance Assessment Rating System (CPARS) evaluation result. 

37.602-4 - “To the maximum extent practicable, performance incentives, either 
positive or negative or both, shall be incorporated into the contract ... These incentives ... 
shall be capable of being measured objectively”. Note that the regulations recognize that 
one size does not fit all. 

46.401 - “Quality assurance surveillance plans should be prepared in conjunction 
with the preparation of the statement of work. The plans should specify (1) all work 
requiring surveillance, and (2) the method of surveillance.” This appears to leave wide 
discretion as to what to include in a QASP. 

Going back to the PBSA definition above, the key to employing performance- 
based methodologies is to be able to describe requirements as outcomes/results and not in 
terms of how to accomplish the requirement. Therefore, a Performance-based Work 
Statement (PWS) or Statement of Objectives (SOO) must be structured to ensure that the 
requirement is carefully articulated in this manner. Accordingly, the integrated solutions 
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team will conduct a series of in-depth analyses to understand the requirement fully in 
order to be able to articulate the desired outcomes. 

E. LESSONS LEARNED 

The GAO report GAO-02-1049, Contract Management, “Guidance Needed for 
Using Performance-Based Service Contracting,”32 addressed the OFPP guidance on 
performance-based contract attributes: 

• Describe the requirements in terms of result required rather than the 
methods of performance of the work. 

• Set measurable performance standards. 

• Describe how the contractor’s performance will be evaluated in a quality 
assurance plan. 

Identify positive and negative incentives, when appropriate. 

The report looked at 25 contracts and how well they met the performance-based 
attributes. The results ranged from nine contracts that clearly exhibited all of the 
attributes to contracts that exhibited only one of the attributes. This study demonstrated 
some of the problems with agencies understanding of performance-based contracting and 
how to take full advantage of it. OFPP recognizes this problem and is in the initial stages 
of developing new guidance on how to improve agency use of performance-based 
contracts. The study raises concern as to whether agencies have a good understanding of 
performance-based contracting and how to take full advantage of it. The better the 
understanding of commercial and performance-based contracting methods, the better the 
expected outcomes. GAO plans to put a task force together to continue to look at issues 
surrounding the definition and composition of performance-based contracting. 

Another good lessons learned experience is Lt Col Casey Blake’s, article “ Cost- 
Effective PBSA. ”33 In this article he addresses the success that Travis Air Force Base 
(AFB) in California has had with performance-based service contracts. The article offers 
some insight into government oversight, team efforts, the cost versus service analysis. 


32 GAO, September 2002. Contract Management: Guidance Needed for Using Performance-Based 
Service Corrtracting. GAO-02-1049. 

33 Casey Blake, May 2001. Cost-Effective PBSA, Contract Management Magazine, May 2001, 
Volume 41, Issue 5. 
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performance-based service contracting process (including process for statements of work 
or objectives) and challenges the acquisition community will be facing as we continue to 
learn about PBSA. 

F, STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

1. Conduct an Analysis 

The teams shall analyze their requirements and results from the market survey to 
determine the needs (what outputs/services are really needed?). This will start to form 
the basis for the performance-based work statement. Using a performance requirements 
summary matrix (like the one found in Appendix B of the Guidebook for PBSA or one of 
the examples found in Ronne Rogin’s paper) start to translate the tasks required to make 
their requirement into performance requirements. Develop performance standards 
(characteristics of acceptable performance levels) and a realistic quality level in order to 
measure the performance. The Guidebook for PBSA describes three “analysis-oriented 
steps” that is “top down” approach to performance requirements analysis: 

• Define the desired outcomes: List what needs to be accomplished in order 
to satisfy the overall requirement. Techniques: (1) Use an interview or 
brainstorming approach with the customer (user) to determine all 
dependent variables (what, when, where, who, quantity, quality levels, 
etc.) or (2) review previous requirements for validity and accuracy. 

• Conduct an outcome analysis: Identify specific performance objectives for 
those outcomes defined in the previous step. Techniques: (1) Segregate 
desired outcomes into lower task levels and link those tasks together into a 
logical flow of activities and/or (2) use a tree diagram to outline each of 
the basic outcomes. 

• Conduct a performance analysis: Identify how a performance objective 
should be measured and what performance standards are appropriate 
(including acceptable quality levels). 

G. READING ASSIGNMENTS FOR SESSION 5 

Pages 11 -12 and Appendix H of the Guidebook for Performance-Based Services 
Acquisition (PBSA) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 17-21 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 


53 



Petersohn, Henry, April 2003. Performance-Based Service Contracting for 
Information Technology Requirements. Contract Management Magazine/April 2003, 
Volume 43/Issue 4 

Jennings, John B. and Jackson, Jr., Clyde P., December 2002. PBSA at the 
Pentagon Contract Management Magazine/December 2002, Volume 42, Issue 12 Pages 
26-27 

Interagency Task Force on Performance-Based Service Acquisition, July 2003. 
Performance-Based Service Acquisition - Contracting for the Future, Executive Office of 
the President, Office of Management and Budget, Office of Federal Procurement Policy 

Department of Energy, August 2001. Performance-Based Contracting: 
Development of a Performance Work Statement, 
http://wwwl.pr.doe.gov/acqguide/AGChapter37.htm (November 2005) 

Kelman, Stanley, August 8, 1997. Performance-Based Service Contracting 
(PBSC) Solicitation/Contract/Task Order Review Checklist, 
http://www.arnet.gov/Eibrary/OPPP/PolicyDocs/pbscckls.html (November 2005) 

Mather, Chip and Cotello, Ann, May 2001. An Innovative Approach to 
Performance-Based Acquisition: Using SOO, Acquisition Solutions, Inc, Acquisition 
Directions, Advisory 
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VII. SESSION 5: THE PERFORMANCE WORK STATEMENT 

(PWS) 


A. LEARNING OBJECTIVES 

1. Learn what a Performance Work Statement is and the process used to 
develop it. 

2. Learn what a Statement of Objectives is and the process used to develop it. 

B. INTRODUCTION 

In this session the performance requirements and outcome analysis will be 
transformed into a performance work statement or a statement of objectives. The 
performance requirements summary becomes the baseline for the performance work 
statement or statement of objectives. In the performance work statement/statement of 
objectives process we will be describing what is needed, when and where it is needed and 
how we will know it is good when it is delivered. 

C. READING MATERIAL FOR SESSION 4 
1. Instructor 

Petersohn, Henry, April 2003. Performance-Based Service Contracting for 
Information Technology Requirements. Contract Management Magazine/April 2003, 
Volume 43/Issue 4 

Jennings, John B. and Jackson, Jr., Clyde P., December 2002. PBSA at the 
Pentagon Contract Management Magazine/December 2002, Volume 42, Issue 12 Pages 
26-27 

Interagency Task Force on Performance-Based Service Acquisition, July 2003. 
Performance-Based Service Acquisition - Contracting for the Future, Executive Office of 
the President, Office of Management and Budget, Office of Federal Procurement Policy 

Department of Energy, August 2001. Performance-Based Contracting: 
Development of a Performance Work Statement, 
http://wwwLpr.doe.gov/acqguide/AGChapter37.htm (November 2005) 

Kelman, Stanley, August 8, 1997. Performance-Based Service Contracting 
(PBSC) Solicitation/Contract/Task Order Review Checklist, 
http://www.arnet.gov/Library/OPPP/PolicyDocs/pbscckls.html (November 2005) 

Mather, Chip and Cotello, Ann, May 2001. An Innovative Approach to 
Performance-Based Acquisition: Using SOO, Acquisition Directions, Advisory, May 
2001, Acquisition Solutions, Inc. 
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2 . 


Student 


Pages 11 -12 and Appendix H of the Guidebook for Performance-Based Services 
Acquisition (PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUlDEBOOK.pdf (November 2005) 

Pages 17-21 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Petersohn, Henry, April 2003. Performance-Based Service Contracting for 
Information Technology Requirements. Contract Management Magazine/April 2003, 
Volume 43/Issue 4 

Jennings, John B. and Jackson, Jr., Clyde P., December 2002. PBSA at the 
Pentagon Contract Management Magazine/December 2002, Volume 42, Issue 12 Pages 
26-27 

Interagency Task Eorce on Performance-Based Service Acquisition, July 2003. 
Performance-Based Service Acquisition - Contracting for the Euture, Executive Office of 
the President, Office of Management and Budget, Office of Eederal Procurement Policy 

Department of Energy, August 2001. Performance-Based Contracting: 
Development of a Performance Work Statement, 
http://wwwl.pr.doe.gov/acqguide/AGChapter37.htm (November 2005) 

Kelman, Stanley, August 8, 1997. Performance-Based Service Contracting 
(PBSC) Solicitation/Contract/Task Order Review Checklist, 
http://www.arnet.gov/Library/OPPP/PolicyDocs/pbscckls.html (November 2005) 

Mather, Chip and Cotello, Ann, May 2001. An Innovative Approach to 
Performance-Based Acquisition: Using SOO, Acquisition Directions, Advisory, May 
2001, Acquisition Solutions, Inc. 

D. PERFORMANCE WORK STATEMENT DEVELOPMENT PROCESS 

According to Guidebook for PBSA,34 let the contractor solve the problem and 
provide the labor mix to do it. Do not write the requirements so tightly that the same 
solution is offered by each offeror. The integrated solutions team will take the 
performance requirements analysis and describe the requirements in such a way the 
offeror will be able to understand fully what will be necessary to accomplish the 
requirements. Appendix H of The Guidebook for PBSA, provides the common elements 
of a performance work statement: 


34 Guidebook for Performance-Based Services Acquisition (PBSA) in the Department of Defense, 
March 2001. 

http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdfSsearch='Performance%20requirements%20analv 

sis%20for%2QPBSA' . (November 2005) 


56 





1. Introduction - Describes program goals, desired results to be aehieved, 
interfaees that must be eonsidered, and any previous problems that have 
been eneountered. The introduetion should provide a quiek reference to 
what is being proeured. 

2. Baekground (optional) - Typieally summarizes historieal information that 
is neeessary for the eontraetor to understand the current requirements. 
Gives the eontraetor an understanding of how and why the requirements 
evolved and where this requirement is headed. This seetion is for 
informational purposes only and no direetions to the eontraetor should be 
ineluded in this seetion. 

3. Seope of Work - This is a summary seetion that briefly deseribes the 
purpose of the current work and the desired outeome. The eontraetor 
should understand the magnitude of the requirement and the seope should 
be eonsistent with the task (requirement/performanee standards). The 
seope description should be at a high-level, emphasizing the most 
important aspects (an overview) of the teehnieal requirements, avoiding 
minor details. 

4. Applieable Directives - The purpose of this section is provide the 
eontraetor with any applieable doeuments that may be needed to eomplete 
the tasks. All doeuments should be properly eited, elearly stating the 
portion that applies. All doeuments should be pertinent to the task to be 
performed. 

5. Requirements/Performanee Standards - This portion is where the 
Performanee Requirements Summary (PRS) matrix is transferred (or 
transformed) into the performanee work statement, in other words, it is the 
textual form of the PRS, whieh eontains greater detail. Adequate 
information that elearly defines the magnitude, quality, and seope of eaeh 
outcome. A good test is if the requirements are speeific enough for the 
writer to determine the levels of expertise, human resourees, and other 
resourees needed to aeeomplish the tasks. Make sure that the eontraetor’s 
responsibilities are stated in such a way that it knows what is required and 
the government ean tell if the eontraetor has eomplied. State the 
requirements in sueh a way that there is no question of whether the 
eontraetor is obligated to perform a speeifie task. The tasks should be 
presented in a logieal and ehronologieal order. The elements of quality 
assurance should be fully eonsidered for all deliverables. All government 
obligations should be earefully and fully delineated, sueh as government 
furnished information and equipment, aeeess to government faeilities, and 
any provision taking eontrol of work away from the eontraetor. Only the 
neeessary requirements should be identified, do not try to over specify and 
try to eliminate “niee to have” or “eateh all” types of statements. 

6. Contract Deliverables - This seetion should establish a schedule of when 
the results happen and a means of doeumenting and delivering the results 
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to the Government. All points of eontrol or deeisions should be clearly 
defined. Specific authorization requirements and instructions for 
providing anything to anyone outside of the contracting officer, 
contracting officer’s representative or designated persons. Designation of 
who can sign the acceptance report to determine if the contractor has 
complied with the requirements. 

7. Data Requirements - This section contains information on data 
requirements, such as reports or any item contained within the Contract 
Data Reports List (CDRL). Strive to minimize data requirements, acquire 
only the data that is absolutely necessary. 

8. Appendices - Contains any information that is both necessary and helpful 
to the contractor for either bidding or performance purposes. 

Other guidelines, such as the Department of Energy’s Guide “Development of a 
Performance Work Statement,”35 provides definitions, analysis, procedures, samples and 
lessons learned that will be helpful with writing the performance work statement. All of 
these guidelines stress the need to write in clear, concise, commonly used, easily 
understood, measurable terms. Identify and define all tasks that are required, ensure there 
is a completion criteria for each task, and the tasks are tied together. Avoid unnecessary 
tasks and any how-too requirements. Keep in mind the following questions; 

• Is there enough information for the contractor to determine what is 
required? 

• Are the tasks written clearly, so that there is no doubt what is intended? 

• Are the tasks stated so that the contractor can price the requirement? 

• Will you know if the contractor complied with this requirement? 

The Guidebook for PBSA provides some language principles that will be very 
helpful in writing the performance work statement. Strive to include all the essential 
information in concise, accurate, thorough, and logical sequence, using the clearest and 
simplest possible presentation. The keys to writing clearly may be summarized as: 

• Use active voice 

• Choose descriptive verbs 

• Distinguish between “shalEwill,” “any/either,” “and, or, and/or, and etc..” 
and “should/may” 


35 Department of Energy, August 2001. Performanee-Based Contracting: Development of a 
Performance Work Statement, http://www 1 .pr.doe.gov/acqguide/AGChapter37.htm . (November 2005) 
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• Avoid ambiguity 

• Avoid generalities, but do not over-speeify 

• Avoid agreements to agree 

• Define all abbreviations and aeronyms 

• Use short, eoncise sentenees 

E, LESSONS LEARNED 

Performanee-Based Serviee Aequisition (PBSA) is always in the spot light and it 
seems that the lessons learned are a eontinuous flow of information. The Offiee of 
Federal Proeurement Poliey put out a report, “Performanee-Based Serviee Aequisition; 
Contraeting for the Future,”36 that made six reeommendations for modifieations to the 
Federal Aequisition Regulation (FAR) to give ageneies more flexibility in applying 
PBSA. It also looked at modifying the reporting requirements to ensure that PBSA is 
applied appropriately and improves the quality, eurrency and availability of the guidanee 
for PBSA. The proposed ehanges may be helpful in improving the way PBSA is applied 
to speeifie requirements. 

The Pentagon Renovation Program team, whieh is responsible for renovating 6.5 
million square feet of office space at the Pentagon, used a PBSA approach for its 
acquisition of information technology (IT) telecommunications services. The article, 
“PBSA at the Pentagon,”37 talks about the application of PBSA, lessons learned, and the 
payoff, which included cost savings and increased customer satisfaction. 

Another article that provides some good lessons learned is “Performance-Based 
Service Contracting for Information Technology Requirements.”38 This article points out 
some of the difficulties in preparation of the procurement because of the many specific 
points of information and defining meaningful performance. This article talks 


36 Interagency Task Force on Performance-Based Service Acquisition, July 2003. Performance-Based 
Service Acquisition - Contracting for the Future, Executive Office of the President, Office of Management 
and Budget, Office of Federal Procurement Policy. 

37 John B. Jennings and Clyde P. Jackson, Jr., December 2002. PBSA at the Pentagon Contract 
Management Magazine/December 2002, Volume 42, Issue 12, pp. 26 -27. 

38 Henry Petersohn, April 2003. Performance-Based Service Contracting for Information Technology 
Requirements. Contract Management Magazine/April 2003, Volume 43/Issue 4. 


59 




specifically about the contract format and sections. This should be helpful in the 
preparation of the performance work statement. 

F. STATEMENT OF OBJECTIVE DEVELOPMENT PROCESS 

According to the Seven Steps to Performance-Based Service Acquisition,39 an 
alternative to the performance work statement is to develop a statement of objectives 
(SOO). There is no set format for a SOO, but a common characteristic is that by their 
inherent nature, they tend to be short direct statement of needs with a minimum of the 
detail than normally found in a PWS or SOW. Typically, a SOO begins with an 
explanation of how the acquisition relates to an agency’s program or mission needs and 
what problem(s) needs solving. The SOO generally should include statements describing; 

1. Purpose - This is a short introduction on what the contract is supposed to 
achieve. This short concise message should relate to the agency’s 
program or mission need and what problem needs solving. 

2. Scope - The scope helps the competition get a grasp on the size and range 
of the services required. Another consideration is the budget authority, 
availability of funds for the acquisition. With this approach, the 
competing contractors will need some insight into the funding authority 
and size of their solution to be realistic and in a competitive range. This 
may be a list of constraints. 

3. Period of Performance - This will also help the competition with an 
understanding of the scope of the effort. If you want them to propose on 
additional periods of performance at the same time, you need to make it 
clear that is your intent. 

4. Place of Performance (if known, if required) - This provides the 
competition with another valuable piece of information, do not assume 
that it is understood. State it clearly so that everyone understands where 
the requirements are needed. 

5. Background - Typically summarizes historical information that is 
necessary for the contractor to understand the current objectives. Gives 
the contractor an understanding of how and why the objectives are needed. 
This section is for informational purposes only and no directions to the 
contractor should be included in this section. 

6. Program Objectives - Here is where the integrated solutions team has to 
decide what problem needs to be solved. This information constitutes the 
core of the statement of objectives. The approach should offer the 


39 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov . (November 2005) 
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contractor the maximum flexibility to propose an innovative approaeh or 
solution to the government. This is the information that the eontraetor is 
going to use to respond baek with a performanee work statement that 
becomes part of the eontract. What needs to be obvious is that these 
objeetives are mission-related, measurable objeetives. These objeetives 
need to be stated in a manner so that the eontraetor and government share 
the goals or the objeetives. This will inerease the likely hood of suceess. 

7. Constraints - These are the neeessary and needed limits the government 
must put on the responses. These restraints may range from where the 
work must take place to regulated by poliey requirements that must be 
adhered to in order for the solution to be aeeeptable or eompatible with 
government systems or polieies. This is an important element of the 
statement of objeetives beeause it provides the limits on the flexibility of 
the offer reeeived. 

The integrated solutions team should examine and delete anything that is not 
essential in the entire statement of objeet before it is released. The Government-prepared 
SOO is usually incorporated into the RFP either as an attaehment or as a part of Seetion 
L. At eontraet award, the contractor-proposed Statement of Work ean be ineorporated by 
referenee or integrated direetly into Seetion C. 

This alternative approaeh to development of the PWS, to develop a Statement of 
Objeetives is further explained in an Aequisition Direetion Advisory “An Innovative 
Approaeh to Performanee-Based Aequisition: Using the SOO,”40 whieh provides some 
lessons learned and an in-depth view of the use of statement of objeetives. This artiele 
emphasizes the need to have a eross-funetional team to plan and manage a procurement. 
It points out the typieal aequisition approaehes fail to put the task where the knowledge is 
and most ageneies have already developed the essenee of the statement of objectives 
during the budget proeess. Statement of objectives offers the eontraetor maximum 
flexibility to propose and innovative approaeh or solution to the government. It also 
plaees signifieant burden on the offerors to do more to respond effeetively and 
eompetitively to the government solieitation. It is to the ageney’s advantage to have 
offerors who really understand the objeetives and use that information to eraft superior 
solutions. The ageney ean differentiate contractors on the basis of the old evaluation 


40 Chip Mather and Aim Cotello, May 2001. An Innovative Approach to Performance-Based 
Acquisition: Using SOO, Acquisition Directions, Advisory, May 2001, Acquisition Solutions, Inc. 
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criteria “Understanding the Requirement.” Tapping into the private seetors innovative 
approaches through the use of statement of objeetives proeess will help meet the 
government wide performanee-based goals. 

Over time as existing contraets approach their expiration or approaeh their Option 
period, transitioning over to this SOO approach in many instances has the potential to 
offer agencies the greatest return on cost-effeetiveness. This return on cost-effectiveness 
should aecrue particularly to the large number of teehnical and engineering support 
aequisitions that ean typically be characterized as having a “diversity of advanced 
teehnical complexity and in whieh there may be no problem yet defined, or there are 
inherent uncertainties and/or lack of specificity associated with the ability to define 
desired outcomes, etc.” Like an aequisition for advanced R&D, it is practically 
impossible to dictate performance requirements for outcomes (solutions) as yet unknown 
or poorly understood until there is sufficient and adequate work product, supporting data 
and knowledge base available in the subject area to justify full implementation of a 
Performance Work Statement. However, application of the Statement of Objeetives 
methodology ean allow the integrated solutions team a breadth of options ranging from 
applieation of performance principles wherever they can be appropriately applied to 
potential full implementation of performance-based contraeting when that is more 
appropriate. In this proeess you may consider a fairly simple solicitation that is the SOO. 
An offeror’s response to the statement of objectives is a contraetor crafted proposed 
performance work statement (solution) with related, offeror-proposed performance 
metrics (Quality Assurance Plan or Quality Assurance Surveillanee Plan). 

G. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

Begin writing the Performance Work Statement. 

There are primarily two means of development of a solution for Performance- 
Based Serviee Acquisitions: (1) by using a Performance Work Statement, or (2) by 
employing a relatively new and emerging methodology built around a Statement of 
Objectives. The teams shall employ both methodologies and select whichever one is 
most suitable to achieve the objeetives most effectively, based upon eharacteristics, 
needs, and requirements unique to the given requirement. The PWS proeess is what is 
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traditionally considered in most performance-based service contracting activities and in 
the FAR. PWS process provides a good ehoice for those instances when you have a well- 
established or historical knowledge base and a reasonably comprehensive understanding 
of the eontemplated technieal serviee. It is also a good ehoice for eontraeting needs for a 
follow-on or related new project, and/or has properly condueted the prerequisite 
outeomes analysis and performance requirements analysis. By whatever means the 
outcomes and requirements analyses are condueted, the integrated solutions team’s 
ultimate objeetive is to take the information so developed and employ it to ereate: 

• A description of the required serviees in terms of outeomes or results 

• Measurable performance standards for the output 

• Defined acceptable quality levels (AQLs) or allowable error rate 

It is important to remember to focus on identifying the essential inputs, processes, 
and outputs during the requirements analysis, not “how” things are done...that’s exactly 
the type of information that is NOT to be included in a PWS. 

The AQL establishes the allowable error rate or variation from the standard. 
Failure to perform within the AQL could result in a contract price reduetion or other 
aetion. To foster relianee on standard eommercial praetices, aequisition teams have the 
option of encouraging contractors themselves to propose standards of serviee, along with 
appropriate price adjustments or other aetions. [All these points—performance standards, 
quality levels, and prieing are negotiable.] 

The Performance Requirements Analysis Matrix, which is a tool used to tabulate 
the desired outeomes, performance objectives, performance standards, and AQLs 
developed through the previously explained analyses, should be used to generate a 
Performance Requirements Summary (PRS). The PRS becomes the baseline for the 
Performance Work Statement. PRSs should be concise and should eapture the relevant 
and essential elements of the requirement. In the actual PWS, the aequisition team will 
elaborate on and describe the requirements in greater detail. Performanee objeetives and 
performance standards are sometimes eombined in one tasking sentence. Similarly, 
performanee standards and AQLs can also be combined. There is no preferred format. 
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The primary objective is to define the requirements in a manner that allows an offeror to 
fully comprehend what will be necessary to accomplish the requirement. 

The integrated solutions [acquisitions] team employs the PRS data, elaborates on 
its contents, and organizes the information into a SOW-like format (introduction, 
background information, scope, applicable documents, performance requirements, [any] 
special requirements, and deliverables, etc.), to develop the Performance Work Statement 
and the Statement of Objectives using precise terms and clear concise wording. The FAR 
requires that a SOO and PWS must at a minimum be structured to: 

• Describe requirements in terms of outcomes (results) rather than 
processes. 

• Use measurable, objective performance standards and quality assurance 
surveillance plans (QASPs). 

• Provide mechanisms for reductions of fees or price. 

• Include performance incentives where appropriate. 

Since the nature of performance-based acquisition is (or should be) tied to 
mission-unique or program-unique needs, it is important to understand that solutions 
developed by other agencies may not provide good or relevant models from which to 
work. Finally, the acquisition teams must remain mindful of the following DOD 
guidance: 

Do not specify the requirements so tightly that you run the risk of getting the 
same solution from each offeror. 

A progress report, to include the market research and Performance Requirements 
Summary (PRS) are due next week. 

H. READING ASSIGNMENTS FOR SESSION 6 

Pages 13-14 and Appendix I of the Guidebook for Performance-Based Services 
Acquisition (PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 26-30 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 
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Garrett, Gregory A., April 2002. Performanee-Based Contraeting Ineentives: 
Myths, Best Praetices, and Innovation. Contraet Management Magazine/April 2002, 
Volume 42/Issue 4 

Owens, James G., Deeember 2003. The Ineentive-Term Arrangement: A New 
Strategy for Creating Value. Contract Management Magazine/December 2003, Volume 
43, Issue 12, Pages 40-41 

Edwards, Vernon J., February 2002. The Award-Term Incentive: A Status Report, 
Contract Management Magazine, February 2002, Volume 42, Issue 2. Pages 22 -27 

Gill, Jim, February 2002. Incentive Contracting, Assessing the Risks, Contract 
Management Magazine, February 2002, Volume 42, Issue 2, Pages 42-44 

Dickinson, Tom, February 2001. A Case for Multiple Incentives, Contract 
Management Magazine, February 2001, Volume 41, Issue 2, Pages 10-13 

Brands, Margaret, February 2001. Another Fook at Award Fee Contracts, 

Contract Management Magazine, February 2001, Volume 41, Issue 2, Pages 18-25 

Edwards, Vernon J., February 2001. Award-Term: The Newest Incentive, 
Contract Management Magazine, February 2001, Volume 41, Issue 2, Pages 44-48 

Scan only: The Under Secretary of Defense (Gansler, J.S.), January 5, 2001. 
Incentive Strategies for Defense Acquisitions, General Policy Guidance, 
http://www.acqnet.gOv/Fibrary/OFPP/BestPractices/pbsc/library/DODincentivesguide02 
01.pdf (November 2005) 
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VIII. SESSION 6: PERFORMANCE INCENTIVES AND PENALTIES 


A. LEARNING OBJECTIVES 

1. Learn how to apply and characterize performance incentives and penalties. 

B. INTRODUCTION 

In this session will be talking about how to use performance-based contracting to 
motivate the contractor to provide the best performance for the least price. This session 
talks about the role positive and negative incentives play in making performance-based 
service acquisition successful. Incentives vary from additional fee to possibly extending 
a contract term for highly successful performance. 

C. READING MATERIAL FOR SESSION 4 
1. Instructor 

Garrett, Gregory A., April 2002. Performance-Based Contracting Incentives: 
Myths, Best Practices, and Innovation. Contract Management Magazine/April 2002, 
Volume 42, Issue 4, Pages 14-19 

Owens, James G., December 2003. The Incentive-Term Arrangement: A New 
Strategy for Creating Value. Contract Management Magazine/December 2003, Volume 
43, Issue 12, Pages 40-41 

Edwards, Vernon J., February 2002. The Award-Term Incentive: A Status Report, 
Contract Management Magazine, February 2002, Volume 42, Issue 2. Pages 22 -27 

Gill, Jim, February 2002. Incentive Contracting, Assessing the Risks, Contract 
Management Magazine, February 2002, Volume 42, Issue 2, Pages 42-44 

Dickinson, Tom, February 2001. A Case for Multiple Incentives, Contract 
Management Magazine, February 2001, Volume 41, Issue 2, Pages 10-13 

Brands, Margaret, February 2001. Another Fook at Award Fee Contracts, 

Contract Management Magazine, February 2001, Volume 41, Issue 2, Pages 18-25 

Edwards, Vernon J., February 2001. Award-Term: The Newest Incentive, 

Contract Management Magazine, February 2001, Volume 41, Issue 2, Pages 44-48 

The Under Secretary of Defense (Gansler, J.S.), January 5, 2001. Incentive 
Strategies for Defense Acquisitions, General Policy Guidance, 

http://www.acqnet.gOv/Fibrary/OFPP/BestPractices/pbsc/library/DODmcentivesguide02 
01.pdf (November 2005) 
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2, Students 

Pages 13-14 and Appendix 1 of the Guidebook for Performanee-Based Services 
Acquisition (PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUlDEBOOK.pdf (November 2005) 

Pages 26-30 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Garrett, Gregory A., April 2002. Performance-Based Contracting Incentives: 
Myths, Best Practices, and Innovation. Contract Management Magazine/April 2002, 
Volume 42, Issue 4, Pages 14-19 

Owens, James G., December 2003. The Incentive-Term Arrangement: A New 
Strategy for Creating Value. Contract Management Magazine/December 2003, Volume 
43, Issue 12, Pages 40-41 

Edwards, Vernon J., Eebruary 2002. The Award-Term Incentive: A Status Report, 
Contract Management Magazine, Eebruary 2002, Volume 42, Issue 2. Pages 22 -27 

Gill, Jim, Eebruary 2002. Incentive Contracting, Assessing the Risks, Contract 
Management Magazine, Eebruary 2002, Volume 42, Issue 2, Pages 42-44 

Dickinson, Tom, Eebruary 2001. A Case for Multiple Incentives, Contract 
Management Magazine, Eebruary 2001, Volume 41, Issue 2, Pages 10-13 

Brands, Margaret, Eebruary 2001. Another Eook at Award Eee Contracts, 

Contract Management Magazine, Eebruary 2001, Volume 41, Issue 2, Pages 18-25 

Edwards, Vernon J., Eebruary 2001. Award-Term: The Newest Incentive, 

Contract Management Magazine, Eebruary 2001, Volume 41, Issue 2, Pages 44-48 

Scan only: The Under Secretary of Defense (Gansler, J.S.), January 5, 2001. 
Incentive Strategies for Defense Acquisitions, General Policy Guidance, 
http://www.acqnet.gOv/Eibrary/OPPP/BestPractices/pbsc/library/DODincentivesguide02 
01.pdf (November 2005) 

D, PERFORMANCE INCENTIVES AND PENALTIES 

J.S. Gansler, The Under Secretary of Defense, wrote in January 200141 “that 
incentives exist in every business arrangement. The effective application of incentives is 
the key to building successful business arrangements that jointly maximize value to all 
parties. It is essential that the Department of Defense adopt incentive strategies to 
successfully attract, motivate and reward traditional and non-traditional contractors, thus 
ensuring successful performance.” 


41 The Under Secretary of Defense (Gansler, J.S.), January 5, 2001. Incentive Strategies for Defense 
Acquisitions, General Policy Guidance. 
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Performance incentives are an essential element of PBSA [FAR 37.602-l(b)(3)] 
(or any contract). An inherent attribute of any contract is to motivate successful 
performance and insure that contractors that fail to perform satisfactorily do not get 
rewarded. Contracting officers are increasingly incorporating specified incentives 
designed to encourage superior performance on the part of the contractors. Additionally, 
in recent years the Government has collected, maintained, and used information on past 
performance for the purpose of evaluating contractor performance for award of future 
work. Contractors that have developed an exceptional track record achieve a greater 
competitive edge in future source selections and thus a stronger assurance of future work. 
Also, contract clauses such as liquidated damages provide a negative incentive if the 
contractor causes harm or damage to the Government resulting from a failure to perform, 
the contractor is obligated to compensate the Government in accordance with the contract 
clause. Basically, contracting practices have demonstrated that various methodologies 
exist that are useful for motivating high-quality performance. This section examines the 
use of incentives and penalties. 

Gregory A. Garrett writes in his article “Performance-Based Contracting 
Incentives: Myths, Best Practices, and Innovations,”42 that the sound use of performance- 
based incentives is key to the success of the performance-based contracting approach. 
The article begins by discussing seven myths, or misperceptions, that often prevent 
organizations from using incentives appropriately. It then presents best practices and 
specific techniques that organizations have found helpful, or even critical, in the effective 
use of performance incentives. Finally, the article discusses some positive ramifications 
of the increased use of performance-based contracting in general and performance 
incentives in particular. Garrett concludes that, when used properly, in situations where 
the government actually requires superior performance toward clearly defined objectives, 
positive and negative incentives can go a long way in helping agencies meet their needs. 

Incentives can be monetary, non-monetary, positive, or negative. They can be 
based on cost, on schedule, or on quality of performance. Regardless of the final 

42 Gregory A. Garrett, April 2002. Performance-Based Contracting Incentives: Myths, Best Practices, 
and Innovation. Contract Management Magazine/April 2002, Volume 42, Issue 4, pp. 14-19. 
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composition and structure of the incentives, the goal is to encourage and motivate the 
best-quality performance. The following characterizes some of the specifie types of 
ineentives and PBSA incentive provisions that are available to be employed in 
aequisitions. 

E. AWARD-FEE CONTRACT ARRANGEMENTS 

Using evaluation factors established in an Award-Fee plan. Award-Fee contraets 
are a tool for subjectively assessing contraetor performance for a given evaluation period. 
They allow eontractors to earn a portion (if not all) of an award-fee monetary pool 
established at the beginning of the evaluation period. The agency unilaterally determines 
the amount of earned fee. In the context of PBSA, the award-fee evaluation will be based 
on a subjective assessment of how well the contractor meets or exceeds the applieable 
performance standards. 

Margaret Brandis writes in an article “Another Look at Award Fee 
Contracting,”43 that does a good job of explaining award fee eontraets for both fixed 
price and cost reimbursable contract types. The award fee contract consists of the 
following components: 

• An estimated eost 

• A base fee, paid on a regular basis and not tied to any evaluation of 
services 

• An award fee, which is the difference between the maximum fee and the 
base fee 

• A payment plan indieating how often contractor performance will be 
evaluated 

• Award criteria that describe the general areas in whieh the eontractor will 
be evaluated. 

The article goes on to say that there is a very real cost associated with award fee 
contraeting. The regular performanee evaluation aspects are an ongoing resouree drain. 
NASA’s (the largest user of award fee contracts) cost to the government averaged 
$38,700 per evaluation period on award fee eontraets. Although there is no mention of 
eontraetor eost, we ean assume their cost would be the same or more for the gathering 

43 Margaret Brands, February 2001. Another Look at Award Fee Contracts, Contract Management 
Magazine, February 2001, Volume 41, Issue 2, pp. 18-25. 
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and presentation of performanee data. In eonelusion, Brandis states that there are 
benefits of award fee eontraets to the government in having the eontraetor foeus on areas 
that are most important to the government, it adds flexibility to the eontraet and allows 
the government to ehange their priorities and award fees are generally higher fees than 
seen on other eontraets therefore motivating the eontraetor to perform. However, the 
requirements for past performanee information make the advantages seem redundant. 
The extra administrative burden imposed on both the government and the eontraetor 
makes an award fee eontraet mueh less desirable eontraet in this era of proeurement 
personnel downsizing. 

Ineentive eontraeting is a foeused approaeh that awards bonus dollars for 
exemplary performanee on a partieular aspeet important to the buyer, as stated by Tom 
Diekinson in his artiele “A Case for Multiple Ineentives.”44 When multiple ineentives 
are planned, several issues should be addressed. The buyer needs to delineate the 
deferent areas where an ineentive is desired. Then eaeh area needs individual 
assessment, whieh ineludes a determination of what is to be measured, the testing 
instrument, eonsisteney of evaluations, and the monetary award assoeiated with the 
evaluation seores. The main point is when a eontraetor addresses ineentives, the 
eontraetor’s priorities are those ineentive areas that will be most benefieial for the 
eompany and not neeessarily all of the tasks in the eontraet. 

F. AWARD-TERM CONTRACT ARRANGEMENTS 

Award-Term arrangements are very similar to award-fee eontraets; however, 
instead of money as eompensation for quality performanee, the eontraetor is awarded 
additional periods of performanee. Or, if performanee is habitually below standard, the 
period of performanee ean be shortened. Award-Term arrangements are most suitable 
when establishment of a long-term relationship is valuable both to the Government and to 
the potential eontraetor. They differ from options in that Award-Terms are based on a 
formal evaluation proeess and do not entail the regulatory proeedures assoeiated with 
prieed options. Award-Term arrangements are relatively new. 


44 Tom Dickinson, February 2001. A Case for Multiple Incentives, Contract Management Magazine, 
February 2001, Volume 41, Issue 2, pp. 10-13. 
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Vernon J. Edwards writes in an artiele, “Award-Term; The Newest Ineentive,”45 
that though award-term is not yet deseribed in the FAR, it is modeled after the award fee 
ineentives described in FAR 16.405-1. Award-term incentive contracts have been in use 
since 1997 and it rewards a contractor for excellent performance by extending the 
contract without competition. The government team monitors the contractor performance 
on the basis of contractually stipulated criteria and reports their findings to government 
term determining official. A true award-term incentive rewards the contractor with legal 
entitlement to a contract extension, not an additional option. An option is a unilateral 
right of the government; a contractor is not entitled to the exercise of an option. But 
under a true award-term incentive, if the contractor’s performance meets the award-term 
criteria stipulated in the contract, and if any stipulated conditions such as continuing need 
and availability of funds are met, then the government must either extend the contract or 
terminate it for convenience or default. Some contracts have been awarded and labeled 
award-term, but should have been called award option or incentive option because the 
contractor’s reward is not an actual extension but merely a government option to extend. 
The Edwards article discusses the advantages and disadvantages of long term 
relationships that may result in this type of incentive contracts. Vernon Edwards 
concludes that it is too early to tell whether the award-term is a good idea. 

James G. Owens’ article “The Incentive-Term Arrangement: A new Strategy for 
Creating Value,”46 talks about what you get when you cross an award-term arrangement 
with an incentive-fee arrangement. As we continue to find new ways to motivate 
superior contractor performance, incentive-term arrangements may be positive or 
negative; they may be monetary or non-monetary (e.g., past-performance evaluation); 
they may be quantitative and objective; or qualitative and subjective. By combining 
features of incentive-fee and award-term arrangements creates a new hybrid call 


45 Vernon J. Edwards, February 2001. Award-Term: The Newest Incentive, Contract Management 
Magazine, February 2001, Volume 42, Issue 2, pp. 44-48. 

46 James G. Owens, December 2003. The Incentive-Term Arrangement: A New Strategy for Creating 
Value. Contract Management Magazine/December 2003, Volume 43, Issue 12, pp. 40-41. 
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incentive-term arrangement. While evolutionary in nature, the incentive-term adds still 
another variation and tool to motivate and award performance levels of the highest 
quality. 

Contraet Management magazine did a follow-up report “The Award-Term 
Incentive: A Status Report,”4V in February 2002 where they examined the use of award- 
term contracts based on a survey of what has been learned about federal ageneies that 
have developed plans to use award-term incentives in contracts. The award-term 
ineentive elements were similar to those used in award-fee eontracts: 

• Award-term clause, 

• Award-term plan, 

• Award-term board, and 

• Term-determining official. 

Contracts with award-term incentives typieally include a base period of 
performance and a number of option periods during which the government observes and 
evaluates the contractor’s performance. During this time the eontractor can earn credits 
towards a eontract extension. Sueh an extension is the “award-terms.” The award-term 
incentive gives rise to many questions, sueh as: 

• How is the award-term incentive any better than options to extend the term 
of the contraet? 

• Is the award-term incentive eonsistent with the Competition in Contraeting 
Act? 

• Does the Federal Acquisition Regulation (FAR) permit the use of award- 
term incentive? 

• What terms and conditions should an agency include in the eontract that 
includes an award-term incentive? 

• How does one set prices for distant award-term periods and what are the 
risks of long-term periods and what are the risks of long-term prieing? 

The article eoncludes that award-term incentive is an unproven idea, too new for 
anyone to make any claims about its effectiveness or suecess. 


47 Vernon J. Edwards, February 2002. The Award-Term Incentive: A Status Report, Contract 
Management Magazine, February 2002, Volume 42, Issue 2, pp. 22 -27. 
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Past Performance: Past performance information can affect decisions to exercise 
options or to make future contract awards. Thus, introduction of positive past 
performance assessments for a contractor into the Contractor Performance Assessment 
Reporting System (CPARS) is a quick way for motivating improved performance or to 
reinforce exceptional performance. Keep in mind that the integrity of a past performance 
evaluation is essential. 

Cost-Based Incentives: Performance incentives are designed to relate profit or fee 
to results achieved by the contractor in relation to identified cost-based targets or 
performance metrics. Regardless of the performance metric, performance incentives must 
be quantified and within a reasonable range (high/target/low). 

Jim Gill’s article “Incentive Contracting Assessing the Risks,”48 addresses the 
risk when cost savings and mission achievement conflict. The theory of incentive 
contracting is that the contractor is motivated by the desire to maximize profit, which 
drives them to meet the performance criteria the government has established in the 
contract. When criteria is for reduced cost to the government the element of risk enters 
the equation in the area of cost management and technical trade-offs, especially where 
government program managers and contractors have different thresholds of risk. Some 
contractors will push the envelope of risk, knowing that the government will force the 
program back to a less risk-rich environment. This article provides another perspective on 
incentive contracting, be careful what you ask for, make sure it meets the real 
requirements of the government. 

For further guidance on incentive strategies, see “Guide to Incentive Strategies 
for Defense Acquisitions,”4 9 Office of the Undersecretary of Defense (Acquisition and 
Technology), January 2001. 


48 Jim Gill, February 2002. Incentive Contracting, Assessing the Risks, Contract Management 
Magazine, February 2002, Volume 42, Issue 2, pp. 42-44. 

49 The Under Secretary of Defense (Gansler, J.S.), January 5, 2001. Incentive Strategies for Defense 
Acquisitions, General Policy Guidance, 

http://www.acqnet.gOv/Librarv/OFPP/BestPractices/pbsc/librarv/DODincentivesguide0201.pdf (November 
2005) 
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G. PENALTIES FOR NON-PERFORMANCE 

Performance-based contracts should specify procedures, remedies, or penalties for 
reductions in price, fee re-determination, or reduction in the period of performance when 
services are not performed or fail to meet contract quality (performance) requirements. 
DOD guidelines instruct: “agencies must give the contractor an opportunity to correct 
nonconforming services at no increase in contract price. While reductions in price may be 
appropriate for a particular circumstance, it is also recognized that it may be more 
feasible to require the contractor to re-perform the service at no additional cost. 
Acceptance procedures should provide the appropriate terms to address less-than- 
satisfactory performance. In cases where commercial item acquisition procedures are 
used, agencies should rely on contractors’ existing quality assurance systems as a 
substitute for acceptance procedures. The bottom line is that agencies should not pay for 
services that do not conform, do not meet performance standards, or have not been 
properly rendered. ”50 

H. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

Continue to develop the performance work statement and start to consider the 
incentives that will be applied to get the best performance from the contractor. Consider 
award fee and award term, but keep in mind the administrative requirements of these 
incentive type contracts. Consider other incentive methods. 

I. READING ASSIGNMENT FOR SESSION 7 

Pages 15-17 and Appendix B and C of the Guidebook for Performance-Based 
Services Acquisition (PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 23-26 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Diemisse, Lisa, June 2003. Performance Metrics for Non-Mathematicians. 
Contract Management Magazine/June 2003, Volume 43, Issue 6, Pages 44-53 


50 Guidebook for Performance-Based Services Acquisition (PBSA) in the Department of Defense, 
March 2001. http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf . (November 2005) 
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Adam, Peter S., November 2003. Performanee-Based Serviee Metries in IT. 
Contraet Management Magazine, November 2003, Volume 43, Issue 11, Pages 18-26 

GAO, June 2003. Best Praetiees: Improved Knowledge of DOD Serviee 
Contraets Could Reveal Signifieant Savings, GAO-03-661 
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IX. SESSION 7: METHODS AND METRICS TO 
ASSESS/MANAGE CONTRACTOR PERFORMANCE 


A. LEARNING OBJECTIVES 

1. Learn the differenee between “Quality Assuranee and “Performanee 
Assessment” and how to develop a Performanee Assessment Plan. 

2. Learn about assessment methodologies. 

B. INTRODUCTION 

In this chapter we discuss development of an approach for measuring and 
managing contractor performance. This is a highly complex process that requires 
consideration of many factors: performance standards and measurement techniques, 
performance management approach, incentives, etc. This component of PBSA is equally 
important to development of the PWS or SOO, because this element establishes the 
strategy for management of the contract to achieve the desired performance objectives. 

C. READING MATERIAL FOR SESSION 7 

1. Instructor 

Diemisse, Lisa, June 2003. Performance Metrics for Non-Mathematicians. 
Contract Management Magazine/June 2003, Volume 43, Issue 6, Pages 44-53 

Adam, Peter S., November 2003. Performance-Based Service Metrics in IT. 
Contract Management Magazine, November 2003, Volume 43, Issue II, Pages 18-26 

GAO, June 2003. Best Practices: Improved Knowledge of DOD Service 
Contracts Could Reveal Significant Savings, GAO-03-661 

2. Students 

Pages 15-17 and Appendix B and C of the Guidebook for Performance-Based 
Services Acquisition (PBSA) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 23-26 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Diemisse, Eisa, June 2003. Performance Metrics for Non-Mathematicians. 
Contract Management Magazine/June 2003, Volume 43/Issue 6, Pages 44-53 

Adam, Peter S., November 2003. Performance-Based Service Metrics in IT. 
Contract Management Magazine, November 2003, Volume 43, Issue II, Pages 18-26 

GAO, June 2003. Best Practices: Improved Knowledge of DOD Service 
Contracts Could Reveal Significant Savings, GAO-03-661 
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D. METHODS AND METRICS TO ASSESS/MANAGE CONTRACTOR 

PERFORMANCE 

Rather than inventing metries or quality or performanee standards, the most 
eurrent (2004) guidance from OFPP51 instructs an integrated solutions team to largely 
rely on established quality standards such as the American Society for Testing Materials 
(ASTM), Military Specifications or Military Standards (MIL SPEC or MIL STD), or any 
relevant commercial standards such as the International Standards Organization (ISO) 
9000 series or “ISO 9000; 2000” series, which is a set of new quality management 
standards that apply to all varieties of organizations in all kinds of discipline areas. Such 
standards can be incorporated into the selection and evaluation criteria. The important 
issue is to recall those determinants that will constitute (define) success for the project 
and to construct the overall performance measurement and management approach on 
those success determinants. An inherent aspect of being able to apply the standards or 
other determinants is the ability to have periodic in-process inspections or surveillance of 
on-going service delivery. This is needed to ensure that the Government receives the 
quality of services required under the contract, and only pays for the acceptable level of 
services received. A Quality Assurance Plan (QAP) or Quality Assurance Surveillance 
Plan (QASP) is intended to measure task/project-specific contractor performance against 
standards (and/or Contractor-proposed performance metrics) in the PWS or associated 
with contractor responses to a SOO. The PWS and QAP or QASP are interdependent 
related documents and must be coordinated. Accordingly, preparation of both documents 
concurrently is both effective and efficient. 

Lisa Diernisse writes in her article “Performance Metrics for Non- 
Mathematicians,”52 that metrics can be incorporated into a contract arrangement, 
typically a performance-based service contract, to measure and evaluate contractor 
performance. Though the primary purpose of the article talked about metrics that may be 


51 An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to Performance- 
Based Services Acquisition. (Access the Web-Enabled version.), p. 23 http://www.acqnet.gov . (November 
2005) 

52 Lisa Diernisse, June 2003. Performance Metrics for Non-Mathematicians. Contract Management 
Magazine/June 2003, Volume 43, Issue 6, pp. 44-53. 
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used by acquisition personnel to measure and evaluate their own performance, she makes 
a lot of good points and gives some good explanations and interpretations of metrics in 
general. 

According to her article, metric means an attribute that can be measured, not the 
measurement itself, although the term “metrics” will mean a system for regularly 
collecting, reporting and interpreting quantifiable performance data to aid in management 
decision-making and/or the data produced by such as system for most of our applications. 
Using metrics can be daunting to people with weak backgrounds in mathematics, 
statistics, and quantitative analysis, Ms. Diernisse provides a simpler, more flexible 
approach that can be tailored to the needs and resources of the acquisition team, and still 
yield useful information. She provides four steps to assist in setting up metrics: 

• Decide attributes, link them to goals/objectives (outcomes) 

• Solicit organizational (team) buy-in 

• Develop data collection tools 

• Report metrics data 

The article also provided ten tips for effective metrics that may be very helpful in 
developing a good metrics for performance-based service acquisition. 

A similar article, written by Peter S. Adam, “Performance-Based Service Metrics 
in IT,”53 expressed that choosing metrics is more of an art than a science especially for 
performance-based service acquisitions. According to Clyde Jackson, Logistics 
Management Agency (LMA), “it is critical for performance standards to be linked 
directly to the desired contract outcome.” In order for efforts and outcomes to link up 
correctly, performance standards must be “measurable, achievable, relevant, and 
controllable.” Adam goes on to talk about the spectrum of contract types from fixed- 
price to cost-reimbursement and the dynamics of choosing appropriate metrics to assure 
proper performance. He goes on to explain how metrics figures in to all aspects of the 
acquisition process. The examples and his table “Metric Selection Summary” will be 
helpful in planning metrics for any performance-based contract. 

53 Peter S. Adam, November 2003. Performanee-Based Serviee Metries in IT. Contraet Management 
Magazine, November 2003, Volume 43, Issue 11, pp. 18-26. 


79 



E, QUALITY ASSURANCE VS. PERFORMANCE ASSESSMENT 

Traditionally, performance-based contracting methods have used the term 
“quality assurance” to refer to the functions performed by the Government to determine 
whether a contractor has fulfilled the contract obligations pertaining to quality and 
quantity. However, the DOD position is that the term “quality assurance,” does not 
adequately characterize the true essence of performance-based service acquisition, since 
agencies do not “assure quality” - rather, they evaluate contractor performance. In a 
performance-based environment, it is the contractor that is contractually responsible for 
quality assurance, further motivated through various kinds of incentives such as award- 
fee and past performance assessments. Agencies remain responsible for ensuring that 
they get what they are paying for - by periodically evaluating contractor performance 
through the appropriate assessment methods. In recognition of this shift in emphasis DoD 
has shown a preference for the term, “performance assessment” instead of “quality 
assurance” in most instances. However, current (’04 and ‘05) uniform practice 
recommended in OFPP guidelines to Government agencies reflects this above nuance of 
interpretation slightly differently by recommending assessment of performance against 
standards through the QAP/QASP mechanism. The discussions that follow will attempt 
some further clarification of the distinctions involving quality control, quality assurance, 
and performance assessment activities in managing contractor performance. 

A quality control plan is a plan developed by the contractor with project/Task- 
specific approaches and performance metrics for its internal use to ensure that it performs 
and provides deliverables/services to the Government that are consistent with established 
high commercial quality standards and meet the contract requirements. Often the quality 
control plan becomes part of the contractor’s original proposal, and in many cases it may 
be incorporated into the resultant contract. 

Simply stated, a contractor’s Quality Assurance Plan is his formally established 
and enforced overall internal organizational policy and documented uniform procedures 
or processes for assuring the extent and accuracy of documentation, data, references, 
background materials, technical protocols, and any [technical] work product associated 
with finished deliverable products. For example, many organizations may follow the 
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standards and be independently eertified as meeting the requirements of “ISO 9000; 2000 
[quality] Standards” of the International Standards Organization and/or similar 
recognized standards organizations, as mentioned above. 

A Performance Assessment Plan should be developed in conjunction with the 
preparation of the performance work statement (PWS), regardless of whether acquisition 
team develops the PWS directly or a contractor develops the PWS from a SOO. For every 
performance objective identified in the Performance Requirements Analysis and 
subsequently included in the PWS, one or more methods for evaluating performance 
should also be identified. Also make sure that the methods allow for adequate assessment 
of the performance standard itself. The Guidebook for PBSA in Department of 
Defense54 suggest Performance Assessment Plan outline; 

• Purpose 

• Roles and Responsibilities 

• Procedures 

• Methods of assessment 

• Successful performance and remedies 

• Certification of services 

• Sample of contract discrepancy report 

• Customer complaint procedures and training instructions 

• Acronyms and other abbreviations 

The performance assessment plan should also outline any acceptance process and 
should state how acceptance of services will occur. 

In general, performance assessment plans should indicate how performance 
information would be captured and documented in such a manner that it complies with 
FAR Part 42 requirements for later access as a source of Past Performance Information 
(PPI). 


54 Guidebook for Performance-Based Services Acquisition (PBSA) in the Department of Defense, 
March 2001. http://www.dau.mil/pubs/misc/PBSA GUIDEBOOK.pdf . (November 2005) 
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Effective use of the performance assessment plan, in conjunction with a 
contractor’s quality control plan, will allow the Government to evaluate the contractor’s 
success in meeting the contract requirements. 

Recommended assessment methods identified in the performance assessment 
plan, together with the contractor’s quality control plan and performance metrics, will 
also aid in evaluating the success with which the contractor delivers the level of 
performance committed to in the contract. 

One of the better examples for the Quality Assurance Surveillance Plan is from 
the United States Patent and Trademark Office (USPTO).55 This sample gives a good 
explanation for each area that is required to be addressed; 

1, Purpose 

This Quality Assurance Surveillance Plan (QASP) is a Government developed 
and applied document used to make sure that systematic quality assurance methods are 
used in the administration of the Performance Based Service Contract (PBSC) standards 
included in this contract and in subsequent task orders issued. The intent is to ensure that 
the Contractor performs in accordance with performance metrics set forth in the contract 
documents, that the Government receives the quality of services called for in the contract 
and that the Government only pays for the acceptable level of services received. 

2, Authority 

Authority for issuance of this QASP is provided under Contract Section E - 
Inspection and Acceptance, which provides for inspections and acceptance of the articles, 
services, and documentation called for in task orders to be accomplished by the 
Contracting Officer or his duly authorized representative. 

3, Scope 

To fully understand the roles and the responsibilities of the parties, it is important 
to first define the distinction in terminology between the Quality Control Plan and the 
Quality Assurance Surveillance Plan. The Contractor, and not the Government, is 


55 United States Patent and Trademark Office, author and date unknown. 
http://www.amet.gov/Librarv/OFPP/BestPractices/pbsc/librarv/USPTOattF DRAFTQASP.doc (November 
2005) 
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responsible for management and quality eontrol aetions neeessary to meet the quality 
standards set forth by the eontraet and follow-on task orders. The Contraetor develops 
and submits his Quality Control Plan (QCP) for Government approval in eomplianee with 
his eontraet deliverables. Onee aeeepted, the Contraetor then uses the QCP to guide and 
to rigorously doeument the implementation of the required management and quality 
eontrol aetions to aehieve the speeified results. The QASP on the other hand, is put in 
plaee to provide Government surveillanee oversight of the Contraetor’s quality eontrol 
efforts to assure that they are timely, effeetive and are delivering the results speeified in 
the eontraet or task order. The QASP is not a part of the eontraet nor is it intended to 
duplieate the Contraetor’s QCP. The Government has provided the Contraetor an 
informational eopy of the QASP as an Attaehment to the solieitation to support the 
Contraetor’s efforts in developing a QCP and for providing the eontraetor an opportunity 
to eomment and propose innovative solutions for the Government’s QASP. 

4. Government Resources 

The following definitions for Government resourees are applieable to this plan. 

a. Contracting Officer 

A person duly appointed with the authority to enter into, administer, or 
terminate eontraets and make related determinations and findings on behalf of the 
Government. 

b. Project Officer 

An individual designated in writing by the Contraeting Offieer to aet as his 
authorized representative to assist in administering a eontraet. The souree and authority 
for a Projeet Offieer is the Contraeting Offieer. Projeet Offieer limitations are eontained 
in the written letter of designation. 

c. Technical Monitor 

An individual appointed by the Projeet Offieer to aet as his authorized 
representative for the teehnieal administration of speeifie task order(s) issued under the 
eontraet. The duties and limitations of the Teehnieal Monitor are eontained in a written 
letter of designation and/or in the body of the issued task order. 
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5, Responsibilities 

The Government resources shall have responsibilities for the implementation of 
this QASP as follows: 

a. Contracting Officer 

The Contracting Officer ensures performance of all necessary actions for 
effective contracting, ensures compliance with the terms of the contract and safeguards 
the interests of the United States in the contractual relationship. It is the Contracting 
Officer that assures the Contractor receives impartial, fair, and equitable treatment under 
the contract. The Contracting Officer is ultimately responsible for the final determination 
of the adequacy of the Contractor’s performance. 

b. Project Officer 

The Project Officer is responsible for technical administration of the 
project and assures proper Government surveillance of the Contractor’s performance. The 
Project Officer is not empowered to make any contractual commitments or to authorize 
any contractual changes on the Government’s behalf. Any changes that the Contractor 
deems may affect contract, price, terms, or conditions shall be referred to the Contracting 
Officer for action. 

c. Technical Monitor 

The Technical Monitor provides detailed technical oversight of the 
Contractor’s performance and reports his or her findings to the Project Officer in a 
timely, complete and impartial fashion to support the Project Officer’s technical 
administration activities. While the Technical Monitor may serve as a direct conduit to 
provide Government guidance and feedback to the Contractor on technical matters, he or 
she is not empowered to make any contractual commitments or to authorize any 
contractual changes on the Government’s behalf Any changes that the Contractor deems 
may affect contract, price, terms, or conditions shall be referred to the Contracting 
Officer for action. 

6, Methods of QA Surveillance 

The below listed methods of surveillance shall be used in the administration of 
this QASP. In addition to specific instructions that may be mentioned, the appropriate 
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and standardized form that is to be used for doeumentation of QA surveillanee is the 
Surveillance Activity Checklist, included as Attachment A. 

a. Customer Feedback 

Customer feedback may be obtained either from the results of formal 
customer satisfaction surveys or from random customer complaints. Customer 
complaints, to be considered valid, must set forth clearly and in writing the detailed 
nature of the complaint, must be signed and must be forwarded to the Project Officer. 

The Project Officer shall maintain a summary log of all formally received 
customer complaints as well as a copy of each complaint in a documentation file. The 
Project Officer shall also keep the tabulated results of all customer satisfaction surveys on 
file and shall enter the summary results into the Surveillance Activity Checklist. 

b. 100% Inspection 

This level of inspection shall be accomplished by monitoring and 
documentation. Each month, the Project Officer, or if so designated the appropriate 
Technical Monitor, shall review the generated documentation and enter summary results 
into the Surveillance Activity Checklist. 

Periodic Inspection - Periodic inspections shall be conducted if and when 
specified in individual task orders. For the potential tasks that have been identified so far 
and included in this QASP, the appropriate Technical Monitor typically performs the 
periodic inspection on a monthly basis. 

c. Random Monitoring 

Random monitoring shall be conducted if and when specified in individual 
task orders. For the potential tasks that have been identified so far and included in this 
QASP, the random monitoring shall be performed by the Project Officer or by the 
appropriate designated Technical Monitor. 

7, Identified QA Surveillance Tasks 

The following PBSC items are identified within the OHR contract Statement of 
Work to be applicable on a wide basis and are to be monitored under this QASP. 

See the Performance Requirements Summary and Section B.9.1 
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For Each Contract Task 


Performance Requirement - As agreed upon between the Contractor and USPTO 
(Government) 

Performance Standard - As agreed upon between the Contractor and USPTO 
(Government) 

Method of Measurement - As agreed upon between the Contractor and USPTO 
(Government) 

Performanee Metrics - As agreed upon between the Contractor and USPTO 
(Government) 

Performanee Ineentives - As agreed upon between the Contraetor and USPTO 
(Government) 

8. Documentation 

The Projeet Offieer will, in addition to providing documentation to the 
Contracting Officer, maintain a complete Quality Assurance file. The file will contain 
copies of all reports, evaluations, recommendations, and any actions related to the 
Government’s performanee of the quality assuranee function, including the originals of 
all Surveillanee Aetivity Checklists. All such records will be retained for the life of this 
eontract. The Project Officer shall forward these records to the Contraeting Offieer at 
termination or completion of the contract. 

9, Attachments 

Attachment A - Surveillance Activity Checklist 


Performance 

Performanee 

Method of 

Performance 

Method of 

Date 

Compliance 

Requirement 

Standard 

Measurement 

Metrics 

Surveillanee 

Accomplished 

(Exeeeded, 
Met or 
Partially 
Met) 


Table 2. Part of sample from United States Patent and Trade Office: 
http://www.arnet.gov/Librarv/OFPP/BestPractices/pbse/librarv/USPTOattF DRA 


FTQASP.doe (November 2005) 
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F. ASSESSMENT METHODOLOGIES 

A variety of methods can be employed to evaluate a contractor’s performance as 
seen in the above example. The following are some other representative examples of 
commonly utilized methods. 

1. Random Sampling 

Random sampling is a statistically based method that assumes receipt of 
acceptable performance if a given percentage or number of scheduled assessments is 
found to be acceptable. The results of these assessments help determine the 
Government’s next course of action vis-a-vis the contractor, if necessary, and whether 
adjustments in this method of assessment are necessary. If performance is considered 
marginal or unsatisfactory, the evaluators should document the discrepancy or finding 
and begin corrective action. If performance is satisfactory or exceptional, they should 
consider adjusting the sample size or sampling frequency. Random sampling is the most 
appropriate method for frequently recurring tasks. It works best when the number of 
instances is very large and a statistically valid sample can be obtained. 

2. Periodic Sampling 

Periodic sampling is similar to random sampling, but it is planned at specific 
intervals or dates. It may be appropriate for tasks that occur infrequently. Selecting this 
tool to determine a contractor’s compliance with contract requirements can be quite 
effective, and it allows for assessing confidence in the contractor without consuming a 
significant amount of time. 

3. Trend Analysis 

Trend analysis should be used regularly and continually to assess the contractor’s 
ongoing performance over time. It is a good idea to build a database from data that have 
been gathered through performance assessment. Additionally, contractor-managed 
metrics may provide added information needed for the analysis. This database should be 
created and maintained by Government personnel. 

4. Third-Party Audits 

The term “third-party audits” refers to contractor evaluation by a third-party 
organization that is independent of the Government and the contractor. All 
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documentation supplied to, and produeed by, the third party should be made available to 
both the Government and the eontraetor. 

The use of a SOO ean be espeeially advantageous and eost-effeetive beeause it 
ean require the eontraetor to propose metries and the QAP, rather than have the 
Government develop it. This is partieularly appropriate when using a SOO sinee the 
solution is not known until proposed. With a SOO offerors are free to develop their own 
PWS solutions (desired outeomes), so it makes sense for them to develop and propose a 
QAP that is tailored to their solution and commereial praetiees. When an ageney develops 
the QAP/QASP, it runs the risk of potentially limiting what eontraetors ean propose. 
Also, when eontraetors propose the performanee metries and the QAP, these beeome true 
effeetive diseriminators among proposals in “best-value” evaluation and source selection. 

GAO report GAO-03-661, Best Praetiees, “Improved Knowledge of POD Serviee 
Contracts Could Reveal Signilieant Savings ,”^^ is on spend analysis programs that eould 
improve serviee proeurements. The report looked at five major eompanies that have 
implemented a spend analysis proeess and demonstrated saving in proeurement spending. 
The key proeesses to spend analysis are: 

• Automation 

• Extraetion of data 

• Supplemental information 

• Organization 

• Analysis and strategie goals 

The purpose of the reading is to look at some examples of eommereial operations 
that uses spend analysis for service aequisition, the results and reeommendations. DOD 
eoneurred with the reeommendations and has taken a number of steps to improve the 
aequisition of serviees. 

G. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

Continue to work on the performanee work statements and develop a metries for 
performanee assessment of the eontraetor after award. 

56 GAO, June 2003. Best Practices: Improved Knowledge of DOD Service Contracts Could Reveal 
Significant Savings, GAO-03-661. 
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H. READINGS FOR SESSION 8 

Pages 13-14 and Appendix B and C of the Guidebook for Performance-Based 
Services Acquisition (PBS A) in the Department of Defense, March 2001 
http://www.dau.mil/pubs/misc/PBSA_GUlDEBOOK.pdf (November 2005) 

Pages 25 - 30 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Reynolds, William E., December 2002. Performance-Based Contracting the 
USAID Experience. Contract Management Magazine/December 2002, Volume 42, Issue 
12, Pages 40-47 

Rosenberger, Robert, December 2003. Performance-Based Contracting in a Non- 
Performance-Based World. Contract Management Magazine/ December 2003, Volume 
43, Issue 12, Pages 42-48 

Martin, Eawrence L., November 2002. Making Performance-Based Contracting 
Perform: What the Eederal Government Can learn from State and Eocal Governments, 
New Ways to Manage Series, IBM Endowment for The Business of Government, 
November 2002 

EAR Part 16: http://www.arnet.gov/far/current/html/PARTOCP16.html 
(November 2005) 
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X. SESSION 8: DETERMINE THE TYPE OF SERVICE 

CONTRACT 


A. LEARNING OBJECTIVES 

1. Learn about the different types of performanee-based serviee eontraets and 
how to piek the right one for your proeurement. 

B. INTRODUCTION 

In this ehapter the integrated solution team should seleet eontraet types that are 
most likely to motivate eontraetors to perform optimally, while eoneurrently maintaining 
eonsisteney with effeetive eontraet management requirements and prineiples. The 
objeetive is to introduce to the maximum extent practicable performance-based operating 
principles and cost reductions for the Government. 

C. READING MATERIAL FOR SESSION 8 

1, Instructor 

Reynolds, William E., December 2002. Performance-Based Contracting the 
USAID Experience. Contract Management Magazine/December 2002, Volume 42, Issue 
12, Pages 40-47 

Rosenberger, Robert, December 2003. Performance-Based Contracting in a Non- 
Performance-Based World. Contract Management Magazine/ December 2003, Volume 
43, Issue 12, Pages 42-48 

Martin, Eawrence L., November 2002. Making Performance-Based Contracting 
Perform: What the Eederal Government Can learn from State and Eocal Governments, 
New Ways to Manage Series, IBM Endowment for The Business of Government, 
November 2002 

EAR Part 16: http://www.arnet.gov/far/current/html/PARTOCP16.html 
(November 2005) 

2, Students 

Pages 13-14 and Appendix B and C of the Guidebook for Performance-Based 
Services Acquisition (PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 25 - 30 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Reynolds, William E., December 2002. Performance-Based Contracting the 
USAID Experience. Contract Management Magazine/December 2002, Volume 42, Issue 
12, Pages 40-47 
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Rosenberger, Robert, December 2003. Performance-Based Contracting in a Non- 
Performance-Based World. Contract Management Magazine/ December 2003, Volume 
43, Issue 12, Pages 42-48 

Martin, Lawrence L., November 2002. Making Performance-Based Contracting 
Perform; What the Federal Government Can learn from State and Local Governments, 
New Ways to Manage Series, IBM Endowment for The Business of Government, 
November 2002 

FAR Part 16; http;//www.amet.gov/far/current/html/FARTOCP16.html 
(November 2005) 

D. CHOOSING THE TYPE OF CONTRACT APPROPRIATE FOR PBSA 

According to Federal Acquisition Regulation (FAR) Part 16,57 contract types are 
grouped into two broad categories; fixed-price contracts (see FAR Subpart 16.2) and 
cost-reimbursement contracts (see FAR Subpart 16.3). The specific contract types range 
from firm-fixed-price, in which the contractor has full responsibility for the performance 
costs and resulting profit (or loss), to cost-plus-fixed-fee, in which the contractor has 
minimal responsibility for the performance costs and the negotiated fee (profit) is fixed. 
In between are the various incentive contracts (see FAR Subpart 16.4), in which the 
contractor’s responsibility for the performance costs and the profit or fee incentives 
offered are tailored to the uncertainties involved in contract performance. 

The contracting model that ideally meets the PBSA objective is a Fixed-Price 
contract. This type of contract is appropriate for services that can be objectively and 
definitively described in a solicitation and for which risk of performance is manageable. 
Unfortunately, the types of solicitation characteristics are atypical of the large majority 
of contracting requirements that traditionally has been based upon Cost- 
Reimbursement type contracts for support services. The decision to employ this type of 
service contracting has been driven by the large number of technical and engineering 
support acquisitions that can typically be characterized as having a diversity of 
advanced technical complexity and in which there may be no problem yet defined, or 
there are inherent uncertainties and/or lack of specificity associated with the ability to 
define desired outcomes or permit costs to be adequately estimated. 


57 Federal Aequisition Regulation (FAR) Part 16: 
http://www.arnet.gov/far/eurrent/htmFFARTOCP16.html . (November 2005) 
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Like most acquisitions for advanced R&D, it is practically impossible to 
dictate performance requirements for outcomes (solutions) as yet unknown or poorly 
understood until there is sufficient and adequate work product, supporting data and 
knowledge base available in the subject area to enable or justify full implementation of a 
Performance Work Statement. 

The integrated solution team reviews the range of contract types and contracting 
options available in the context of meeting performance-based service contracting 
principles while at the same time trying to address the above project technical 
complexities and engineering characteristics and potential performance 
management ambiguities that are common to professional service contracting 
experience base. Under law and regulation (OFPP),58 there is an order of preference in 
contract types used for performance-based contracting, as follows: 

(i) A firm-fixed price performance-based contract or task order 

(ii) A performance-based contract that is not firm-fixed price 

(iii) A contract that is not performance-based 

The FAR provides an array of contract types to accommodate the acquisition of 
various types of services and supplies. Contract types vary according to 1) the degree and 
timing of the responsibility assumed by the contractor for the costs of performance, and 
2) the amount and nature of the profit or other incentive offered to the contractor for 
achieving or exceeding specified standards or objectives. These contract types provide a 
range of allocation of risk of contract performance between the contractor and the 
Government. Procurement professionals and program offices must select contract types 
and pricing arrangements that are compatible with the nature of a specific requirement, 
support the tenets of performance-based contracting, except for the exclusions identified 
in FAR 37.102 and guidance provided by the OMB-OFPP Memorandum of September 7, 


58 Page 25 of An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to 
Performanee-Based Serviees Aequisition. (Aeeess the Web-Enabled version.) http://www.aeqnet.gov . 
(November 2005) 
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2004.59 The objective is to introduce, to the maximum extent practicable performance- 
based operating principles and cost reductions for the Government. 

OFPP counsels, however, that Agencies must take care in implementing this order 
of precedence. There should be awareness that a firm-fixed price contract is not the best 
solution for every requirement. “Force-fitting” the contract type can actually result in 
much higher prices as contractors seek to cover their risks. This view is upheld by FAR 
16.103(b) which indicates, “A firm-fixed-price contract, which best utilizes the basic 
profit motive of business enterprise, shall be used when the risk involved is minimal or 
can be predicted with an acceptable degree of certainty. Flowever, when a reasonable 
basis for firm pricing does not exist, other contract types should be considered, and 
negotiations should be directed toward selecting a contract type (or combination of types) 
that will appropriately tie profit to contractor performance.” The decision about the 
appropriate type of contract to use is clearly tied to the sponsor’s needs and can go a long 
way toward motivating superior performance or contributing to poor performance and 
results. Market research, informed business decision, and negotiation will assist in 
determining the best contract type. A range of contract types and contracting options are 
available in the context of meeting performance-based service contracting principles, 
while at the same time trying to address sponsor project technical complexities and 
engineering characteristics and potential performance management ambiguities that are 
consistent with performance-based contracting requirements and regulations. 

1, Firm Fixed-Price Contracts (FFP) 

A firm-fixed-price performance-based contract provides for a price that is not 
subject to any adjustment on the basis of the contractor’s cost or risk experience in 
performing the contract. This performance-based contract type places full responsibility 
and maximum risk upon the contractor for all costs and resulting profit or loss. It 
provides maximum incentive for the contractor to control costs and perform efficiently, 
while imposing a minimum administrative burden upon the contracting parties. Firm 
Fixed-Price performance contracts should be employed for routine repetitive services 

59 Robert A. Burton, September 7, 2004. Inereasing the Use of Performanee-Based Serviee 
Aequisition, Offiee of Management and Budget, http ://www. aeqnet. gov/Notes/MemoCAO- 
PE%20Reporting%20Requirements.T:)df (November 2005) 
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where speeific, well-defined seopes of work and outputs [outcomes] can be written; 
where quantities and rate of services and/or products delivery is known at the outset of 
the contract; and when available cost or pricing information permits realistic estimates of 
the costs of performance. This type of contract is NOT DESIRABLE where uncertainties 
exist or flexibility is needed during contract performance. In most cases the contractor 
will provide only what is called for in the specification or PWS and relevant performance 
metrics in order to minimize his costs and risks and, conversely maximize his profit on 
the contract’s fixed price. If many uncertainties or risks exist in the performance of the 
contract, it is likely the contractor will factor-in the cost of contingencies in its price, 
which could result in a greater cost to the Government than if some alternative cost-type 
contract were used. 

2, Fixed-Price Contracts with Provisions for Economic Price 
Adjustment 

A fixed-price performance-based contract with provisions for economic price 
adjustment provides for upward and downward revision of the stated contract price upon 
occurrence of specified economic contingencies. The use of this variant of the EEP 
contract is suitable when contract performance will occur over an extended period of 
time, when there is uncertainty in the ability to project cost fluctuations for services or 
other relevant deliverables from established price norms during the period of 
performance, or when the foreseeable potential exists for actual labor and/or materials 
cost contingencies external to and/or beyond the contractor’s or Government’s control 
might occur during the period of the contract. 

3. Fixed-Price Incentive Fee (FPIF) Contracts 

A fixed-price incentive (firm target) type of contracting approach for a 
conventional contract provides for adjusting profit and establishing the final contract 
price by a formula based upon the relationship of final negotiated allowable cost of 
contract to total target cost. The final price is subject to a price ceiling (the negotiated 
allowable cost), negotiated at the out-set of the contract. This type of incentive 
contracting may be particularly useful in situations where the use of a EEP contract is not 
prudent because of the level of estimating uncertainties, but where uncertainties are not of 
such a degree as to justify the use of a cost-reimbursement type of contract. The modest 
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flexibility under this type of contraeting may allow the contraetor to reaeh agreement on 
priee for certain requirements that would not be achievable in a firm fixed-price 
environment. However, the ceiling price of this type of contract must be high enough 
above the target price to provide a realistic and meaningful incentive range. 

Incentive contracts are designed to obtain specific acquisition objectives by (1) 
establishing reasonable and attainable targets that are clearly communicated to the 
contractor; and (2) including appropriate incentive arrangements designed to motivate 
contractor efforts that might not otherwise be emphasized, resulting in a discouragement 
of contractor inefficiency and waste. Elaborate incentive provisions that require a 
considerable investment of time to administer must be weighed against the expected 
benefits to the Government. 

4. Cost-Reimbursable (CR) 

Contracts that reimburse the contractor for allowable costs as prescribed in the 
contract. CR contracts only offer minimum incentive for the contractor to control cost 
unless additional incentives are provided. CR contracts range from fixed-fee to no-fee 
contracts. A CR contract establishes a limit on the amount of allowable costs that may be 
incurred thus obligating government funding to pay for the effort being authorized and 
establishing the contractor’s fee for successful performance. 

5. Cost-Plus-Fixed-Fee (CPFF) 

Contracts that allow the contractor to receive reimbursement for allowable cost, 
up to the funded amount (ceiling or obligated funds), plus the negotiated fee. This fee is 
fixed from the inception of the contract and does not vary with actual cost unless it is a 
result of work being changed under the contract. 

6. Cost-Plus-Incentive-Fee (CPIF) 

Contracts that provide for reimbursement of allowable costs, up to the funded 
amount (ceiling or obligated funding), plus a fee that is adjusted by a formula in 
accordance with the contract. Under a CPIF contract there is a negotiated initial target 
cost, a target fee, a minimum and maximum fee, and a fee adjustment formula that is 
dependent on how well the contractor meets the target requirements. 
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7, Cost-Plus-Award-Fee (CPAF) 

Contracts that provide a fee eonsisting of a base fee, fixed at the inception, and an 
award fee, determined by how well the eontraetor meets the periodic milestones set forth 
in the contract. 

8, Cost-Sharing (CS) 

A contract that the contractor receives no fee and is reimbursed only for an agreed 
portion of its allowable eosts. 

9, Cost-Without-Fee (CWF) 

A contraet that is a Cost-Reimbursement contraet in whieh the Contractor 
receives no fee. The benefit to the Contractor in accepting such a contract may be 
technology gain. 

10, Cost-Plus-Award-Term Contract (CPAT)60 

This is not a recognized ineentive eontraet by FAR at this time, but is one that is 

beeoming more eommonly used for serviee eontracts. This is a performanee-based type 
of contraet that awards the eontraetor additional periods of performanee instead of money 
as eompensation for quality performanee. Or, if eontraetor performance is habitually 
below standard, the period of performance can be shortened. The effective use of an 
Award-Term incentive demands a high level of contracting knowledge and skill during 
contract formation. It requires that aequisition planners effectively solve many complex 
incentive design problems. It requires that the contracting parties communicate clearly 
and work together effectively when negotiating contract terms and drafting contract 
language in order to ensure a eommon understanding of the nature of this undertaking. It 
requires a new approach to contract management, one in which the parties openly 
acknowledge that they cannot see or plan far into the future and that this contract may be 
incomplete, and in whieh they agree to learn together, adjust their expectations when 
necessary, and engage in cooperative, ad hoc decision making during the course of 
performance in order to fill the gaps in their original agreement. The contractor’s level of 


60 Page 27 of An Interagency-Industry Partnership in Performanee, date unknown. Seven Steps to 
Performance-Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov . 
(November 2005) 
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risk in this contracting approach is comparable to that which typically is reserved for 
Cost-Plus-Fixed-Fee eontracts. 

An Award-Term Determination Plan is the basis for the evaluation of the 
Contractor's performance and for presenting an assessment of that performance to a Term 
Determining Offieial (TDO). For example, eontraetor evaluation proeess for each Term 
Determination increment begins immediately after eompletion of the first Quarter phase- 
in of an awarded eontract or Contraet Line Item Number (CLIN) (beginning month 4) 
and ends nine (9) months from that date on the one-year anniversary of the subject 
T.O./D.O./CLIN unless the work is eompleted earlier. Contraetor performanee should be 
assessed on a continuing basis by review of Contraet Deliverables, teehnieal meetings, 
and general contacts with the Contraetor. Interim contract management performanee 
reviews should be conducted quarterly and formal contractor Quality Performance 
Reviews (QPR) must be condueted on a twelve (12) month interval. The Contract Base 
Performanee Period is typieally one (1) year and may be extended in one-year “Award- 
Term” increments, up to an additional four (4) years, based upon an overall satisfactory 
QPR contract performance under the Contract. The Plan describes the speeific criteria 
and proeedures to be used to assess the Contractor’s performance and to determine the 
earned Award-Term entitlement. Actual Award-Term determinations and the 
methodology for determining the Award-Term are unilateral deeisions made solely at the 
discretion of the Government. 

Any Contract Award-Term extensions earned are re fleeted in unilateral Contraet 
modifications as determined by the TDO. The Award-Term earned is determined by the 
TDO based upon review of the Contraetor’s performance against the criteria set forth in 
the Performanee Plan. The TDO may unilaterally change the Plan prior to the beginning 
of an evaluation period. Changes to the Plan that are applieable to a current evaluation 
period must be incorporated by mutual eonsent of both parties. 

The Award-Term Determination Plan contractually entitles the Contraetor to a 

minimum of one (1) Award-Term Contract extension per year based upon the 

Government’s requirements to exercise incremental extension years plus the Contractor 

sustaining no less than satisfaetory Interim or QPR performanee scores annually to be 
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able to qualify for such incremental Award-Term extensions. Term extensions are only 
subject to cancellation based upon: discontinuance of the Government requirement; lack 
of appropriated funding; termination for the Government’s convenience in the event that 
the Contractor is deemed “no longer responsible” as defined by FAR 9.100; TDO 
determinations of marginal, or unsatisfactory Contractor performance ratings; TDO 
determinations of inconsistent Contractor performance that demonstrates a decline from 
satisfactory or better to marginal or unsatisfactory; six-month notice to opt out of the 
Contract by the Contractor to the Government; and Federal regulatory or legal prohibition 
of Award-Terms or restraints on the duration of contracts. 

NOTE: Award-Terms Not Earned - If the Contractor fails to earn an Award- 
Term by the end of the Base Performance Period, the activities and Award-Term 
incentive provisions of the Contract are suspended pending Contract performance review 
by the Award Term Review Board (ATRB). The ATRB will make a final determination 
and recommendation to the TDO and CO regarding terms for Contract Continuation or 
Termination for cause. The suspension, voiding, or cancellation of any Award-Term 
incentive for any reason stated by the Government shall not be considered either a 
termination for convenience or a termination for default and shall not entitle the 
Contractor to an equitable adjustment or any other compensation. 

11. Hybrid ID/IQ Cost-Plus-Performance-Fee (CPPF) Task Order 
Contract 

This is an Indefinite Delivery/Indefinite Quantity Task/Delivery Order cost- 
reimbursement, performance-based type of contracting approach modeled after the cost- 
plus-award-fee contract format to apply performance-based principles to the maximum 
extent possible to contracting activities with mixed levels of risk that would have 
typically been addressed by the traditional ID/IQ CPEE Task Order-type contracting 
approach. Characteristics of this type of performance-based contract vehicle can be 
summarized as follows: 

• There is less risk for the contractor than a cost-reimbursement incentive 
fee type of Task Order Contract because the Government pays all 
allowable costs, and the Performance Fee established at contract inception 
is not directly linked to or subject to later adjustment by a formula based 
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on the relationship of total allowable costs to total target costs of the T.O., 
and is incrementally paid out periodically during performance of the T.O. 

• It is a desirable contracting form when it is not possible to implement any 
form of fixed-price contracting due to characterization of the acquisition 
as having a number of requirements [but not necessarily all] containing: a 
diversity of advanced technical complexity in which there may be no 
problem yet defined, or there are inherent uncertainties and/or lack of 
specificity associated with the ability to define desired outcomes or permit 
costs to be adequately estimated and in which the exact times and/or exact 
quantities of future services deliveries are not known at the time of 
contract award. 

• Definitive PWS and QAP/QASP requirements can be established for 
individual Task Orders. 

• Periodic evaluations are conducted at quarterly intervals during 
performance and results communicated to the contractor. 

• The Performance Fee elements included in each individual Task Order 
consist of: 

• A Performance-Criteria Rating Plan based upon the metrics in the 
T.O. QAP/QASP by which performance will be evaluated. 

• A Base Amount [of fee] (may be zero) that is established at the 
beginning of the T.O. award and paid to the contractor on the basis 
of the number of Direct Productive Labor Hours (DPLH) actually 
delivered relative to the number of DPLH targeted for the T.O., 
and 

• A Performance Amount [of fee] that the contractor may earn in 
whole or in part during T.O. performance, based on periodic 
evaluation of contractor performance against the Performance- 
Criteria Rating Plan, and that is sufficient to provide motivation for 
excellence in such areas as quality, timeliness, technical ingenuity, 
cost-effective project management, etc. 

• The amount of the Performance Fee to be paid is determined solely by the 
Government’s unilateral judgmental evaluation of the contractor’s 
performance in terms of criteria defined in the Performance-Criteria 
Rating Plan. 

12, ID/IQ Cost-Plus-Fixed-Fee (CPFF) Task/Delivery Order Contract 

This is a NON-performance-based, Indefinite Delivery/Indefinite Quantity 
Task/Delivery Order cost-reimbursement type of contract. It is characterized by 
providing for payment to the contractor of a negotiated fee that is fixed at the inception of 
the contract. This fee does not vary with actual allowable incurred costs, but may be 
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adjusted as a result of ehanges in the scope of work to be performed under the contract. A 
CPFF contract may be used when there is an absence of a reasonable basis for firm 
pricing or there is a need for flexibility in performance of contract requirements because 
the contractor is judged to be at risk as a result of diverse advanced technical 
complexities in which there may be no problem yet defined, or there are inherent 
uncertainties and/or lack of specificity associated with the ability to define desired 
outcomes or permit costs to be adequately estimated and in which the exact times and/or 
exact quantities of future services deliveries are not known at the time of contract award. 
A cost-plus-fixed-fee contract may take one of two basic forms — completion or term. 
The completion form describes the scope of work by stating a definite goal or target and 
specifying an end product. The term form describes the scope of work in general terms 
and obligates the contractor to devote a specified level of effort for a stated time period. 
Because of the differences in obligation assumed by the contractor, the completion form 
is preferred over the term form whenever the work, or specific milestones for the work, 
can be defined well enough to permit development of estimates within which the 
contractor can be expected to complete the work. 

13. Hybrid ID/IQ Multi-Format Task/Delivery Order Contract 

If the requirements are of a highly complex nature a combination of contract types 
utilizing traditional fixed-price, cost-reimbursement, and performance-based principles 
may be desirable to maximize contractor performance and cost efficiencies for the 
Government. This integrated multiple-format type of contract could be structured by the 
acquisition team to select and apply to each individual Task Order, within the context of 
the whole contract, the most appropriate contracting and pricing strategy based upon an 
analysis of the characteristics and risks associated with any given T.O. This would make 
it possible to include FFP Task Orders, FPIF task orders, CPPF task orders, CPFF task 
orders, and other suitable forms into one encompassing contracting vehicle with 
performance-based attributes to facilitate optimization of benefits to the Government. 
The only constraint in proper development of such a hybrid contracting vehicle would be 
to make certain that all provisions and requirements in the contract are in compliance 
with their relevant authorities or guidelines as defined under the FAR - Part 16. 
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Lawrence L. Martin’s paper on “Making Performance-Based Contracting 
Perform: What the Federal Government Can Learn from State and Local 
Governments,”61 is a good lessons learned document with case studies that illustrate 
examples of how to make performance-based service contracts work in the federal 
government. The report starts by looking at some key characteristics of federal 
contracting and the importance performance-based contracting will have to our future. It 
follows up with a perspective of federal performance-based contracting. This includes 
definitions, essential elements of performance-based contracting and problems with the 
federal perspective. It goes on to address the state and local government perspective on 
performance-based contracting with case examples. These case examples provide insight 
into what is working in the commercial sector as well as state and local governments. 

Robert Rosenberger’s article, “Performance-Based Contracting in a Non- 
Performance-Based World,”62 provides some insight into the application of incentives 
and how they can benefit programs using performance-based contracts. Mr. Rosenberger 
recommends that we use equal incentives, based on a system of equal positive and 
negative incentives for each performance criteria, good performance earns positive 
reward (“carrot”) and poor performance earns a negative reward (“stick”). He offers up a 
few illustrations in the form of tables that help explain his position. His conclusion is 
that our contracts should be as innovative as the knowledge and technological services 
that we buy. 

Another article of interest is by William E. Reynolds, “Performance-Based 
Contracting: The USAID Experience”63 looks at The United States Agency for 
International Development (USAID) and the application of performance-based 
contracting for overseas development projects. A different application of performance- 


61 Lawrence L. Martin, November 2002. Making Performance-Based Contracting Perform: What the 
Federal Government Can learn from State and Local Governments, New Ways to Manage Series, IBM 
Endowment for The Business of Government, November 2002. 

62 Robert Rosenberger, December 2003. Performance-Based Contracting in a Non-Performance- 
Based World. Contract Management Magazine/ December 2003, Volume 43/Issue 12. 

63 William E. Reynolds, December 2002. Performance-Based Contracting the USAID Experience. 
Contract Management Magazine/December 2002, Volume 42/Issue 12. 
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based service acquisition that demonstrates its flexibility when the three basic elements of 
PBS A are applied; 

• Clearly defined results that describe the government’s requirements, 

• Measurable performance standards (indicators) and a quality assurance 
plan, and 

• Specific procedures for either “negative incentives” or “positive 
incentives” for contractor performance. 

A different application with common characteristics that can be good lessons 
learned. 

E. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

Teams should be in the process of writing their performance work statements and 
may want to consider using a checklist for performance work statement (Statement of 
Work) as well as their Quality Assurance Surveillance Plan (QASP). A checklist from 
the Air Force, found on http ://www.usafa. afmil/1 Oabw/1 Omsg/lgc/q ape/Checklist, doc 
(November 2005) or from the Office of Management and Budget (0MB) found on 
http://www.arnet.gov/Librarv/OFPP/PolicvDocs/pbscckls.html (November 2005) may be 
helpful to the teams in their efforts. 

F. READINGS FOR SESSION 9 

Pages 18-19 of the Guidebook for Performance-Based Services Acquisition 
(PBS A) in the Department of Defense, March 2001. 
http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 31 - 36 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Hunt III, George R., September 2001. Comparing Source Selection Techniques. 
Contract Management Magazine/September 2001, Volume 41, Issue 9, Pages 10-16 

Gardner, Steve W., June 1998. Source Selection in a Streamlined Acquisition 
Environment, Best Business Practices, PM; May-June 1998 

Garrett, Gregory A., May 2005. Performance-Based Acquisition; The Real 
Essential Elements, Contract Management Magazine, May 2005, Volume 45, Issue 5, 
Pages 42-49 
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XI. SESSION 9: CONTRACTOR SELECTION PROCEDURES 


A. LEARNING OBJECTIVES 

1. Learn about the eontraetor seleetion proeess, the importanee and how to 
develop the proeess to meet your PBSA requirements. 

B. INTRODUCTION 

In this session we are evaluating souree seleetion teehniques. This is very 
important for the integrated solutions team to have a means to seleet their newest member 
of the team, the eontraetor. The first key to seleetion of the best eontraetor relies on the 
sueeess of the team to deseribe the problem that needs to be solved in terms of objeetives 
and outeomes and to allow the eontraetors to eompete through proposing solutions. The 
proeess deseribe here-in provides some teehniques that may be used to help the team 
make that deeision. 

C. READING MATERIAL FOR SESSION 9 

1. Instructor 

Hunt III, George R., September 2001. Comparing Souree Seleetion Teehniques. 
Contraet Management Magazine/September 2001, Volume 41, Issue 9, Pages 10-16 

Gardner, Steve W., June 1998. Souree Seleetion in a Streamlined Aequisition 
Environment, Best Business Praetiees, PM: May-June 1998 

Garrett, Gregory A., May 2005. Performanee-Based Aequisition: The Real 
Essential Elements, Contraet Management Magazine, May 2005, Volume 45, Issue 5, 
Pages 42-49 

2. Students 

Pages 18-19 of the Guidebook for Performanee-Based Serviees Aequisition 
(PBSA) in the Department of Defense, Mareh 2001. 
http://www.dau.mil/pubs/mise/PBSA_GUIDEBOOK.pdf (November 2005) 

Pages 31 - 36 of An Interageney-Industry Partnership in Performanee, date 
unknown. Seven Steps to Performanee-Based Serviees Aequisition. (Aeeess the Web- 
Enabled version.) http://www.arnet.gov (November 2005) 

Hunt III, George R., September 2001. Comparing Souree Seleetion Teehniques. 
Contraet Management Magazine/September 2001, Volume 41, Issue 9, Pages 10-16 

Gardner, Steve W., June 1998. Souree Seleetion in a Streamlined Aequisition 
Environment, Best Business Praetiees, PM: May-June 1998 
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Garrett, Gregory A., May 2005. Performanee-Based Aequisition; The Real 
Essential Elements, Contract Management Magazine, May 2005, Volume 45, Issue 5, 
Pages 42-49 

D. SELECTING THE RIGHT CONTRACTOR 

Seven Steps to Performance-Based Services Acquisitions^ provides guidance on 
selecting the right contractor for a performance-based service acquisition. In order to 
select a contractor, the Government must establish a rule that defines the basis upon 
which it will decide which proposed offer is most advantageous to the Government. 
Historically, agencies have used two decisional rules. The first rule recognizes selection 
of the offeror whose proposal is technically acceptable and who offers the lowest price. 
This is referred to as the Eowest-Price-Technically-Acceptable (EPTA) method of source 
selection. The second rule requires selection of the offeror whose proposal reflects the 
best combination of features, regardless of whether the offeror’s price is the lowest. This 
is defined as the Best-Value method of source selection and preferred with performance- 
based service acquisitions. 

The contractor must understand the performance-based approach, know or 
develop an understanding the agency’s requirements and have a history of performing 
exceptionally in the specific elements. Developing an acquisition strategy that allows 
competition for the solution and has a basis for awarding to right contractor. 

Past performance is an important key in evaluating future performance. There are 
two familiar methods of assessing contractor’s past performance. Asking the offerors to 
provide references and seeking information from their references or using past 
performance information databases. The Past Performance Information Retrieval System 
(PPIRS) is a government-wide repository (http://www.ppirs.gov (November 2005)). 
These archived records of evaluations of contractor past performance then become a 
reference resource that can be accessed by any Government agency that would like to 
review the factual history of a given contractor’s previous work for the Government for 
future source selection purposes. Past performance is an aggregation of three (3) things: 

64 Pages 31-36 of An Interagency-Industry Partnership in Performance, date unknown. Seven Steps 
to Performance-Based Services Acquisition. (Access the Web-Enabled version.) http://www.amet.gov . 
(November 2005) 
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1) observations of the historieal faets of a eompany’s work experienee - what work was 
performed, when and where it was performed, whom it was done for, and what methods 
were employed; 2) qualitative judgments about the breadth, depth, and relevanee of that 
experienee based on those observations; and 3) qualitative judgments about how well the 
eompany performed its tasks, based on those observations. 

Regardless of the method used, the past performanee eriteria must provide 
information that is relevant, eurrent and aeeurate. For example, the information 
requested of the eontraetor and evaluated by the integrated solutions team should be 
designed to determine how well, in eontraets of similar size, seope and eomplexity, the 
eontraetor— 

• Conformed to the eontraet requirements and standards of good 
workmanship. 

• Adhered to eontraet sehedules. 

• Foreeasted and eontrolled eosts. 

• Managed risk. 

• Provided reasonable and eooperative behavior and eommitment to 
eustomer satisfaetion. 

• Demonstrated business-like coneern for the interest of the eustomer. 

Combining past performanee with best-value allows flexibility in seleetion 

through tradeoffs between the eost and non-eost evaluation faetors with the intent of 
awarding to the eontraetor that will give the government the greatest or best value for the 
eost. The integrated solutions team should eonsider ineluding faetors sueh as the 
following in the evaluation model: 

• Quality and benefits of the solution 

• Quality of the performanee metries and measurement approaeh 

• Risks assoeiated with the solution 

• Management approaeh and eontrols 

• Management team (limited number of key personnel) 

• Past performanee (how well the eontraetor has performed) 

• Past experienee (what the eontraetor has done) 
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Best value souree seleetion involves subjeetive analysis and should not be 
reduced to a mechanical, mathematical exercise. The source selection officials have 
broad discretion in determining the manner and extent they will use the technical and 
price tradeoffs in negotiated procurements. It is important to plan the source selection 
process carefully and follow the plan. 

Vernon J. Edwards teaches techniques in source selection, the following is one of 
his samples used in his course “Oral Presentation for Source Selection.”65 

E. SAMPLE EVALUATION FACTORS FOR AWARD 

1. General 

The Government will award the contract to the offeror representing the best 
overall value. The Government will determine best overall value on the basis of the 
factors described below. Offer (Proposal). The Government will evaluate offers 
(proposals) for acceptability on a pass or fail basis. The Government will consider an 
offer to be acceptable if - and only if - it manifests the offeror's unconditional assent to 
the terms and conditions of the REP, which include the statement of work. The 
Government will not consider any offer that takes exception to any term or condition of 
the Request for Procurement (REP), or that otherwise fails to manifest the offeror's 
unconditional assent to a term or condition, to be unacceptable, unless the REP expressly 
provides that assent to the term or condition in question is not mandatory. Any 
unauthorized exception or failure will constitute a deficiency (see PAR 15.001). An 
offeror may eliminate a deficiency in its offer only through discussions. The Government 
intends to award the contract without discussions. 

2. Offeror Capability 

The Government will evaluate the capability of the offerors, which submitted 
acceptable offers (proposals). The Government will evaluate their capability on the basis 
of: (1) experience, (2) past performance, (3) understanding of the work, and (4) 
compliance with REP instructions, as follows. 


65 Vernon J. Edwards, Copyright © January 1997. Oral Presentation for Souree Seleetion, by Vernon 
J. Edwards (Stated in eourse material: Registered students may eopy without further permission.) (Penny S. 
Kennedy and Joe T. MeClure were registered students in V. Edwards eourse). 
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a. Experience 

Experience is the opportunity to learn by doing. The Government will 
assess each offeror's work records to determine whether, during the past years, the offeror 
has had the opportunity to learn about relevant work processes and procedures and about 
the nature, difficulties, uncertainties and risks associated with performing the work that 
will be required under the prospective contract. The Government will try to determine 
how many opportunities an offeror has had, as a business entity, to carry out those 
processes and procedures and to cope with those difficulties, uncertainties, and risk. The 
Government will not attribute to an offeror the individual experience of the offeror's 
current or prospective employees. 

b. Past Performance 

Past performance is a measure of the degree to which an offeror, as an 
organization, has: (1) satisfied its customers, and (2) complied with federal, state, and 
local laws and regulations. The Government will inquire about: (1) the quality and 
timeliness of the offeror's work; (2) the reasonableness of its prices, costs, and claims; (3) 
the reasonableness of its business behavior-its willingness to cooperate and helpfulness in 
solving problems; (4) its concern for the interests of its customers; and (5) its integrity. In 
the investigation of an offeror's past performance the Government will contact former 
customers and government agencies, and other private and public sources of information. 
The Government will not attribute to an offeror the individual past performance of the 
offeror's current or prospective employees. 

c. Understanding of the Work 

The Government will evaluate each offeror's understanding of the work on 
the basis of its oral presentation and the responses it gives during the question and answer 
session that will follow the oral presentation. In making this evaluation the Government 
will consider an offeror's: (1) knowledge of the content of the work in terms of its 
constituent activities, their inputs and outputs, and their interrelationships and 
interdependencies; (2) recognition of the appropriate sequence and realistic duration of 
the work activities; (3) knowledge of the appropriate types of resources required to 
perform the work and of their appropriate allocation to the work activities; (4) familiarity 
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with the difficulties, uncertainties, and risks associated with the work; and (5) knowledge 
of the personnel and subcontractor qualifications necessary to the performance of the 
work. 

d. Compliance with RFP Instructions 

The Government will assess the extent to which each offeror complied 
with the letter and the spirit of the instructions in this RFP. The Government will consider 
any failure to comply with the letter or the spirit of these instructions to be indicative of 
the kind of behavior that it could expect during contract performance and of a lack of 
capability to perform satisfactorily. 

(1) Level of Confidence and Expected Value. The Government 
will determine its level of confidence in each offeror on the basis of its evaluation of the 
offeror's capability. Level of confidence will be a subjective rating which will reflect the 
degree to which the Government believes that an offeror is likely to keep the promises it 
made in its offer. The Government will use this rating in order to determine the relative 
expected value of each offeror's promises. 

(2) Relative Importance of the Factors. Since an offer must be 
acceptable in order for an offeror to be eligible for contract award, and since the 
Government will evaluate acceptability on a pass or fail basis, acceptability of the offer 
(proposal) is the most important evaluation factor. In deciding which, of the offerors 
submitting an acceptable offer is the best overall value, the Government will consider an 
offeror's capability and the Government's level of confidence in the offeror to be 
significantly more important than price. When assessing offeror capability, the 
Government will consider experience, past performance, understanding of the work, and 
compliance with RFP instructions to be equally important. 

(3) Determining Best Overall Value. In order to determine 
which offeror represents the best overall value, the source selection authority will make a 
series of paired comparisons among only those offerors that submitted acceptable offers 
(proposals). If, in any paired comparison, the offeror with the higher expected value also 
has the lower price, then the source selection authority will consider that offeror to 
represent the better overall value. If the offeror with the higher expected value has the 
higher price, then the source selection authority will decide whether the difference in 
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expected value is worth the difference in price. If the source selection authority decides 
that it is, then he or she will consider the offeror with the higher expected value and the 
higher price to represent the better overall value. If not, then the source selection 
authority will consider the offeror with the lower expected value and the lower price to 
represent the better value. The source selection authority will continue to make paired 
comparisons in this way until he or she has identified the offeror representing the best 
overall value. 

The Source Selection Authority (SSA) may base final selection of 
contractors upon an objective Level of Confidence Assessment Rating (LOCAR) best- 
value analysis and determination considering the factors; Technical Capabilities, Past 
Performance, and Cost. An adjectival or numerical rating system is employed with the 
offerors, ranked in order of their overall score. 

F, KEYS TO SOURCE SELECTION 

The first key to selection of the best value contractor relies on structuring its 
acquisition in such a manner that it describes the problem that needs to be solved and 
defines the objectives or outcomes that need to be achieved, and by allowing vendors to 
compete by proposing solutions. Then, the overall quality of the proposed solution and 
the contractor-proposed performance measures and methodology become true 
discriminators in a “best-value” evaluation. A contractor’s oral presentations by their 
proposed project manager and key personnel can further clarify the proposed solution(s) 
and demonstrate their capability, understanding of the requirements, and evidence their 
ability to function effectively as a team. 

Development by the integrated solutions team of a sound acquisition strategy that 
will lead to selection of the right contractor for a given project is extremely important in 
performance-based acquisition. While there are many aspects to crafting an effective 
acquisition strategy among the most important to the acquisition team for performance- 
based procurement are to compete the solution, to make a competitive range 
determination of those contractors most likely to offer a successful solution, to evaluate 
them heavily on past performance information, to request oral presentations as 
appropriate, and to make a “best-value” contractor selection decision. 
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George R. Hunt III writes on “Comparing Souree Selection Techniques.”66 This 
article written in early 2001, comparing different techniques for conducting the source 
selection process provides a variety of source selection techniques and tools available to 
allow a source selection team to conduct a source selection, the article choose three tools 
to compare and contrast: 

• Classical method 

• FEDSelect 

• Expert Choice 

The background presented a brief discussion of the importance of conducting a 
thorough and consistent evaluation in accordance with the procurement package. He 
went on to talk about the regulations, factors and sub-factors, common scoring methods, 
decision support software, and types of evaluation systems. The comparison looked at 
both advantages and disadvantages to each of the methods or systems. In conclusion, he 
reverted back to each acquisition is different, but having proper factor use and weighting, 
as well as appropriate scoring methods, will make the solicitation and evaluation 
manageable. 

Another article that may be useful in understanding source selection processes, is 
Et. Col. Steve W. Gardner’s, “Source Selection in a Streamlined Acquisition 
Environment.”67 Gardner comes at source selection from a different perspective implying 
that source selection teams should be encouraged to use common sense and integrity 
(what makes sense), but make it as simple as you can make it. The article goes through 
the writing of the proposal, particularly sections E and M, what the offeror is required to 
submit for evaluation and how it will be evaluated. He goes on to talk about source 
selection libraries, this is where all documents reside and additional information is stored 
as it is created. Building effective source selection teams is the key to an efficient source 
selection. Eactors should be streamlined to a set up of criteria and weightings according 
to what makes sense, not to a preordained rule. Training is also an important factor, 

66 George R Hunt III, September 2001. Comparing Souree Seleetion Teehniques. Contraet 
Management Magazine/September 2001, Volume 41, Issue 9, pp. 10-16. 

67 Steve W. Gardner, June 1998. Souree Seleetion in a Streamlined Aequisition Environment, Best 
Business Praetiees, PM: May-June 1998. 


112 



training need not be extensive, but it should eover at least one factor and all levels of 
evaluation. He concludes that streamlined source selection is more challenging, but 
much more rewarding, and can lead to shorter source selection periods and saving 
significant time and money. 

Gregory A. Garrett’s May 2005 article, “Performance-Based Acquisition: The 
Real Essential Elements,”®^ discusses what he calls, the real essential elements of 
success, the four Ps: “People, Processes, Performance, and Price.” He presents these 
elements through a series of case studies and attempts to demonstrate, though some 
experts may disagree saying it is too simplistic, the premise of the four Ps in 
performance-based acquisition as the essential elements for success. He concludes that 
“Together, the right people using the right processes will achieve the right performance, 
which should drive the right price (strategy and arrangement) for the specific acquisition 
situation.” Remember, “Simplicity is the ultimate sophistication.” 

G. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

The integrated solutions teams shall finish their projects by developing a source 
selection strategy and adding the source selection plan to their package. Remember that 
no matter how good your performance work statement describes the problem that needs 
to be solved and defines the objectives or outcomes that need to be achieved, selection of 
the right contractor will depend also on your source selection process. It is important that 
vendors compete by proposing solutions that meet your requirements, but it is equally 
important to be able to distinguish between the best performers and to make an award 
that has the best opportunity for success. The next session. Session 10, will be the final 
learning session for the class. The last two sessions (Sessions 11 and 12) will be reserved 
for team presentations of their projects and packages. All completed projects are due at 
the end of Session 10. 

H, READINGS FOR SESSION 10 

Pages 20 of the Guidebook for Performance-Based Services Acquisition (PBSA) 
in the Department of Defense, March 2001. 

http://www.dau.mil/pubs/misc/PBSA_GETDEBOOK.pdf (November 2005) 

68 Gregory A. Garrett, May 2005. Performance-Based Acquisition: The Real Essential Elements, 
Contract Management Magazine, May 2005, Volume 45, Issue 5, pp. 42-49. 
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Pages 37-41 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Reed, Anne and Welch, Bob, November 2005. Performance-Based Acquisition 
Reguires the Six Disciplines of Performance-Based Management, Contract Management 
Magazine, November 2005, Volume 45, Issue 11, Pages 16-25 

Burman, Allan V., July 2000. Moving Backward to Get Ahead, Government 
Executive Magazine, July 2000, Volume 5 No. 3 

Eawther, Wendell C., January 2002, Contracting for the 21st Century: A 
Partnership Model, New Ways to Manage Series, January 2002, The 
PricewaterhouseCooper Endowment, The Business of Government. 
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XII. SESSION 10: EFFECTIVE MANAGEMENT OF POST¬ 
AWARD CONTRACT PERFORMANCE 


A. LEARNING OBJECTIVE 

1. Learn about the importanee of effeetive management of post-award 
eontraet performanee and how the PBS A “Team” must stay intaet and 
assume different roles and responsibilities. 

B. INTRODUCTION 

In this final session we diseuss really a whole new subjeet, the management of 
performanee-based service contracts. This is really where the work starts, but if we have 
done a good job implementing the process then this should make for effective means for 
post-award management of the contract. The important difference between the traditional 
service contracts and performance-based service acquisition is the team must stay 
together with the addition of the contractor and work with the contractor to achieve the 
objectives and outcomes. The team’s roles and responsibilities may change, but they are 
the most informed consumer for the effort and are the best qualified to evaluate how well 
the contractor has met the requirements. 

C. READING MATERIAL FOR SESSION 10 

1, Instructor 

Reed, Anne and Carter, Svetlana, May 2004. Performance-Based Acquisition 
Requires the Six Disciplines of Performance-Based Management, Acquisition Directions 
Advisory, May 2004, Acquisition Solutions, Inc. 

Reed, Anne and Welch, Bob, November 2005. Performance-Based Acquisition 
Requires the Six Disciplines of Performance-Based Management, Contract Management 
Magazine, November 2005, Volume 45, Issue II, Pages 16-25 

Burman, Allan V., July 2000. Moving Backward to Get Ahead, Government 
Executive Magazine, July 2000, Volume 5 No. 3 

Lawther, Wendell C., January 2002, Contracting for the 21st Century: A 
Partnership Model, New Ways to Manage Series, January 2002, The 
PricewaterhouseCooper Endowment, The Business of Government. 

2. Students 

Pages 20 of the Guidebook for Performance-Based Services Acquisition (PBSA) 
in the Department of Defense, March 2001. 

http://www.dau.mil/pubs/misc/PBSA_GUIDEBOOK.pdf (November 2005) 
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Pages 37-41 of An Interagency-Industry Partnership in Performance, date 
unknown. Seven Steps to Performance-Based Services Acquisition. (Access the Web- 
Enabled version.) http://www.acqnet.gov (November 2005) 

Reed, Anne and Welch, Bob, November 2005. Performance-Based Acquisition 
Reguires the Six Disciplines of Performance-Based Management, Contract Management 
Magazine, November 2005, Volume 45, Issue 11, Pages 16-25 

Burman, Allan V., July 2000. Moving Backward to Get Ahead, Government 
Executive Magazine, July 2000, Volume 5 No. 3 

Eawther, Wendell C., January 2002, Contracting for the 21st Century: A 
Partnership Model, New Ways to Manage Series, January 2002, The 
PricewaterhouseCooper Endowment, The Business of Government. 

D. EFFECTIVE MANAGEMENT OF POST-AWARD CONTRACT 

PERFORMANCE 

The Seven Steps to Performance-Based Service Acquisition69 provides formal 
guidance in the form of “Best Practices” to all Federal acquisition operations that are 
trying to comply with performance-based contracting. For the sake of consistency and 
completeness in preparing these performance-based contracting guidelines for 
application by the acquisition team, the following summarizes the Best Practices. 

“The final step of performance-based acquisition is the most important. Unlike 
legacy processes where the contract is awarded and the team disperses, there is a growing 
realization that “the real work” of acquisition is in contract management. This requires 
that agencies allocate sufficient resources, in both the contracting or program offices, to 
do the job well.” 

Many contracting staff learned their job when the culture was to maintain an arm's 
length distance (or more) from contractors and, by all means, limit the amount of contact 
the contractor has with program people. That approach would not work in today's 
environment and especially not in performance-based acquisition. The contractor must 
be part of the acquisition team itself, a reality recognized by the guiding principles of the 
federal acquisition system. 


69 Pages 37-41 of An Interagency-Industry Partnership in Performance, date unknown. Seven Steps to 
Performance-Based Services Acquisition. (Access the Web-Enabled version.) http://www.acqnet.gov . 
(November 2005) 
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FAR 1.102(c) provides: “The Aequisition Team consists of all participants in 
Government aequisition, ineluding not only representatives of the technieal, supply, and 
procurement communities but also the eustomers they serve, and the eontraetors who 
provide the produets and serviees.” 

“Effective contract management is a mission-eritieal agency function. To a large 
degree, the management of contraet performance is guided by the contraefs terms and 
conditions...” It is achieved with the support of the business relationships and 
eommunieations established between the eontraetor and the integrated aequisition team 
deseribed above. To be successful in performance-based aequisition, the recommendation 
is that at least a core of the integrated aequisition team for the projeet be retained intaet 
[now as an integrated solutions team] to participate in contraet management. Those on the 
team have the most knowledge, experience, and insight into what needs to happen next 
and what is expeeted during eontraet performanee. Effective and effieient eontraet 
performance that delivers a solution is the goal. It is reeommended that the team should 
stay together with an adjustment in roles and responsibilities to see that end reached. 

Einally, the Best Practiees guidanee reeommends having a formal eontraet post¬ 
award “kick-off meeting to be attended by those who will be involved in eontraet 
performance and to formally add the contractor to the integrated solutions team at that 
time and to assure that ageney and eontraetor personnel will work elosely together to 
fulfill the mission and program needs. At the same time, notice should be given that 
eontraet management performanee reviews, not for formal reporting and rebutting, but 
for maintaining the projeet on eourse, measuring performanee levels, and making 
neeessary adjustments, will be held at pre-determined intervals. The foeus of these 
review meetings should be on improving performance - not evaluating people; issues 
recommended for examination at eaeh meeting should include: 

• Is the aequisition aehieving its eost, schedule, and performance goals? 

• Is the contractor meeting or exeeeding the eontraefs performance-based 
requirements? 

• How effective is the contraetor's performance in meeting or contributing 
to the ageney's program performance goals? 

• Are there problems or issues that we can address to mitigate risk? 
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• Is there anything that the Government is requiring that affeets the 
eontraetor's job in terms of quality, eost, sehedule, or delivery of the 
solution? 

The review meeting is an ideal time to informally discuss evaluations of the 
contractor's performance, as dictated by the contract terms and conditions and 
requirements of the FAR. FAR 42.15 now requires that agencies evaluate contractor 
performance for each contract in excess of $100,000. The performance evaluation and 
report is shared with the contractor, who has an opportunity to respond before the 
contracting officer finalizes the performance report. In well-managed contracts, there has 
been continual feedback and adjustment, so the review meetings should provide for no 
surprises on either side. 

E. MEASURING 

When measuring performance the team has to decide on specific measures 
(measure the right things). The team should thoroughly understand the process they are 
measuring and should map out (take apart) and analyze, rather than assume, the process 
and outcome that will best satisfy the customer. The measurements should be central to 
the success of the process or outcome, targets of minimum and/or maximum should be 
defined. 

Performance goals (benchmark measurements) are a common practice that will 
help both the contractor and the evaluators to understand the standard of measurement. 
By setting reasonable and attainable goals it will both motivate the contractor’s 
performance and provide a benchmark for measurement by the acquisition (solutions) 
team. This also increases the understanding of the organization’s mission and goals and 
unifies the workforce and helps emphasize the team philosophy. Other considerations are 
change and tolerance or variance (an acceptable range of variance for performance 
targets) in measurements. Some of our goals may change due to the nature of the 
business, priorities, or regulatory requirements. The team should develop the change, 
look at what needs to be measured and make the adjustments in the performance 
standards. But, be cautious of too many changes, although some are healthy and 
necessary, frequent changes will cause confusion and effect accountability. 
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F. GATHERING DATA 

When gathering data the team needs to keep it focused, keep it flexible, keep it 
meaningful, and keep it consistent. 

Keeping data gathering focused is very much a senior leadership responsibility. 
This focus ensures that the right data and only the right data are collected, that repetitious 
or tangential compilations are avoided, and that the questions originally posed by the 
performance measures are being answered. 

Keeping data gathering flexible refers to the way in which data is collected. In 
the best of organizations data are collected from a variety of sources and through a 
variety of media. Any one system is not necessarily the right or wrong way to collect 
data and although automation is preferred, use the most cost efficient and accurate way to 
gather data. 

Useful and relevant data can be gathered when the correct measures were set up in 
the first place. A few well-aligned measures taken seriously are better than a number of 
complex measurements that no one pays any attention too. But, on the other hand, do not 
make it too simplistic, be clear what data needs to be collected; with well-aligned 
measurements so that it is easy to see the data’s relevance. To have effective 
performance measurements, the data collection must be tailored and thoughtful, not 
derived from a “one-size-fits-all” master checklist. 

Consistency in data collection provides for a common framework of 
understanding that can be easily compared and analyzed, allowing subsequent 
evaluations to be comparable (“apples to apples”). 

The acquisition team (including the contractor after award) is responsible for 
collection of the data. The data collected is then analyzed for each performance measure 
to determine if and how well goals are being met. It is very easy for the data collection 
and analysis phase of performance measurement to get out of hand. It is important to 
remember that data collection and analysis are not a research activity, but rather data are 
collected and analyzed to get answers. Through it all, the team must remain focused on 
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the questions they are trying to answer. This focus on strategic alignment makes data 
collection a dynamic and vital, rather than a tedious and never-ending exercise. 

G. DATA ANALYSIS 

Data analysis is the process of converting raw data into performance information 
and knowledge. The data that have been collected are processed and synthesized and can 
then be compare to the actuality, to what they had expected to happen, decide why there 
might be a variance, and determine what corrective action might be required. With 
today’s technology, many tools for effective performance analysis are readily available. 
Off-the-shelf software packages can perform straightforward aggregation/disaggregation, 
statistical analysis, linear programming, trend analysis, charting, quality control, 
operations research, process cost analysis, and forecasting. More sophisticated packages 
can also perform a wide range of quality control functions and econometric modeling. 

Performance data can be displayed in a wide variety of ways, including graphic 
presentations such as histograms, bar charts, pie charts, and scatter diagrams. Most 
organizations use some form of spreadsheets and databases to organize and categorize 
their performance data. Information technology advances particularly in electronic 
communications will provide still more options for data display and dissemination. 

H. REPORTING 

This last set of activities is the subject of the next section reporting and using 
performance information. Performance information should be disseminated quickly. 
Getting useful information to the organization's decision makers promptly and efficiently 
is critical. There are many communication means that can meet this objective, including 
meetings, reports and e-mail, publications, and videoconferencing. Intranets are also 
being used to give entire organizations access to performance data summaries; this gives 
them the opportunity to be proactive about issues or adverse trends. Another performance 
reporting objective is to keep employees at all levels “in the loop,” interested, and 
motivated. 

Bob Welch and Anne Reed state that “Performance-based acquisition and 
management requires an inherent shift in an agency’s culture, from one focused on 
control and oversight, compliance, and direction, to one focused on partnership. 
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collaboration, performance, and ultimately results,” in their article “Performance-Based 
Aequisition Requires the Six Disciplines of Performance-Based Management.”70 The six 
disciplines are: 

1. Cultural Transformation - Proaetively manage the organizational and 
cultural changes integral to the suecess of he initiative; 

2. Strategic Linkage - Provides a eonsistent vision throughout the 

organization, making sure the desired results reflect organizational 
strategic goals; 

3. Governance - Establish roles, responsibilities, and decision making 
authorities for project implementation; 

4. Communieations - Identify the eontent, medium, and frequeney of 

information flow to all stakeholders; 

5. Risk Management - Identify, assess, monitor, and manage risks; and 

6. Performance Monitoring - Analyze and report status - cost, schedule, and 
performanee - on a regularly seheduled basis during project execution. 

In this article they try to put the “how” into the direction that needs to be taken in 
order for integrated solutions teams to beeome integrated management teams. This is a 
big transition where the environment must promote and encourage measuring 
performanee and delivery results, motivate teams and organizations, stimulate 

government and contractors to achieve desired results and establish a repeatable proeess. 
This is good place to start with change, because that is what it will take in order for the 
government to be a successful manager of performance-based service contraets. 

The paper, “Contraeting for the 21st Century: A Partnership Model,”7i by 
Wendell C. Lawther, Associate Professor of Public Administration, University of Central 
Florida, writes about current trends and ehallenges influencing contracting and contract 
administration. His look at the ehanging environment, performance-based service 
eontraeting and changing roles in eontract administration will provide some insight into 
the future of contracting and contract administration. He goes on to talk about the 


70 Anne Reed and Bob Welch, November 2005. Performance-Based Acquisition Requires the Six 
Disciplines of Performance-Based Management, Contract Management Magazine, November 2005, 
Volume 45, Issue 11, pp. 16-25. 

71 Wendell C. Lawther, January 2002, Contracting for the 2L‘ Century: A Partnership Model, New 
Ways to Manage Series, January 2002, The PricewaterhouseCooper Endowment, The Business of 
Government. 
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complexity and uncertainty service/product contracting and the relationship between the 
private and public sectors. In his conclusion, he compares the contractor-customer 
relationship to the public-private partnership. Public-private partnership introduces more 
complex contracting and a new era of how we may do business in the future. 

The last article by Allan V. Burman, “Moving Backward to Get Ahead,”72 
describes performance-based contracting as a very different process, one in which you 
start with the desired end-state. Burman stated, “It’s the outcome that helps you define 
the types of services to acquire as well as the performance standards needed to insure 
quality. This approach encourages contractor innovation, focuses all parties on results, 
and saves money by allowing greater flexibility in how the outcome is produced.” 

From here on out, most all service contracts issued by the Department of Defense 
will be Performance-Based.73 OFPP Policy Letter 91-2, Service Contracting,” 
established that: 

It is the policy of the Federal Government that (1) agencies use 
performance-based contracting methods to the maximum extent 
practicable when acquiring services, and (2) agencies carefully select 
acquisition and contract administration strategies, methods, and techniques 
that best accommodate the requirements. 

The intent is for agencies to describe their needs in terms of what is to be 
achieved, not how it is to be done. These policies have been incorporated in the Federal 
Acquisition Regulation Subpart 37.6 (Performance-Based Contracting). 

Law and regulation establish a preference for performance-based service 
acquisition. This Administration continues a long line of support for this acquisition 
approach. As cited in the Procurement Executives Council's Strategic Plan: 

...over the next five years, a majority of the service contracts offered 
throughout the federal government will be performance-based. In other 
words, rather than micromanaging the details of how contractors operate. 


72 Allan V. Burman, July 2000. Moving Backward to Get Ahead, Government Executive Magazine, 
July 2000, Volume 5 No. 3. 

73 Page 2 (Introduction)- An Interagency-Industry Partnership in Performance, date unknown. Seven 
Steps to Performance-Based Services Acquisition. (Access the Web-Enabled version.) 
http://www.acqnet.gov . (November 2005) 
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the government must set the standards, set the results and give the 
eontraetor the freedom to aehieve it in the best way. 


Presidential Candidate George W. Bush on June 9, 2000 
I. STUDENT/CLASS ASSIGNMENT, ACTIVITIES 

The next two sessions will be presentations by the Integrated Solution Teams. 
Eaeh Team will have approximately 50 minutes to make their presentations, be prepared 
to answer questions from both the elass and the instructor. 
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XIII. CONCLUSION 


Performance-based service acquisition is here to stay. Though implementation 
has been slow, it offers significant gains in contract quality, potential for cost savings, 
contractor responsiveness, and customer satisfaction. DOD and all other federal agencies 
are committed to the implementation of PBSA. Federal agencies spend billions of tax 
dollars each year to buy services and DOD is, by far, the government’s largest purchaser 
of services. Training is an important element toward improving the further 
implementation of PBSA. 

This instructor guide and material focused mainly on the PBSA acquisition 
process through award of the performance-based contract. Understanding this process 
and crafting a performance work statement or statement of objectives that describe the 
work objectives in terms of what is to be the required output rather than how the work is 
to be accomplished and placing the responsibility for that accomplishment on the 
contractor are key elements of PBSA. 

We should have learned the four basic requirements from the materials: 

• Outcomes or requirements defined the work in measurable, mission 
related terms 

• Measurable performance standards tied to requirements or outcomes 

• Includes a plan and methodology for measuring performance against 
standards 

• Performance incentives to promote contractor achievement of desired 
outcomes and/or performance objectives. 

To achieve these key elements it requires an integrated solution team that 
communicates effectively and understands the impact each of these elements have on the 
success of the procurement. It would be a better training environment if the integrated 
solution team members could all train together, technical, program, financial, logistics, 
legal and contracting staff Knowing this is not possible, the next best thing is to train 
them the same way. This instructor guide and material should be adaptable for training 
any member of the integrated solution team. 
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In closing, the most important aspect of a PBSA occurs in post-award, managing 
the results rather than managing the eomplianee. Of course, it does not work to have 
requirements for the contraetor to comply, only to find that the requirements do not meet 
the mission need. This is the purpose of the integrated solutions team. But, there is a 
growing realization that for PBSA, the real work is in the post-award, performanee 
management of the eontraet. The same integrated solutions team that planned the 
proeurement, should be responsible for management of the outeome. The roles and 
responsibilities may slightly ehange, but performanee management is the key to the 
overall sueeess of PBSA. This is probably the most crucial cultural change that needs to 
taught and implemented, for integrated solution teams to eommit to the full PBSA 
implementation. 
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